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ABSTRACT 

Two important elements of a method of designing 
instructional alternatives (MODIA) are comprehensively discussed in 
this paper. .The "Questionnaire for Stating General Policy" is briefly 
reviewed to reveal how goals, student population veiriations, and 
operations must be accommodated before specifying instructional 
strategies. The actual sttategy specifications are constructed 
through DISTAF (Determining Iristructidnal Strategies for Training in 
the Air Force) , a computer directed logic tree that assists in 
planning the instructional methodology. DISTJ^ has been diesigned for 
use ^-:ith either a simple manual that presentis strategies or a complex 
computer program tliat enables the planner to use up to 57 different 
teaching strategies^ /The computerized tree allows the planner to take 
account of memy different levels of subject matter difficulty and 
student jaibilities . .DISTAF presents th variety of 

choices during tJie develpEpent of a Workable strategy* .It cam 
categorize students into txacks , choosey types of examinations and 
learning experiences, and enable the plahher to construct detailed 
strategies in 10 to 30 minutes* . (MC) 
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PREFACE 



This is one of four interrelated reports describing Rand work for the Air Force 
to date on the development of methodologies for designing programs of instruction. 
The reports in the series are: 

R4018.PR, An Overview of MODIA: A Method of Designing Instructional 

Alternatives for Air Force Training, jPolly Carpenter. 
R-1019.PR, The MODIA Decision Pfv^ for Developing Strategies of Air 

Force Instruction, Polly Carpenter and Barbara Homer. 
R4020.PR, The MODIA Questionnaire for Curriculum Analysis, Rudy 

Bretz. 

R-1021-PR, MODIA Applied in the Design and Cost Analysis of an Innova- 
tive Air Force Course, Robert L. Petruschell and Polly Caipenter. 

The first of these provides an overview of the methodologies being developed; the 
second and third describe some of the mcgpr analytical tools.Uj9ed to provide inputs 
to the design process; and the last sets forth the results of a completed design pycle, 
parts of which were.carried out manually, applied to a specific course in Air Force 
technical training. 

This work has been conducted under a Rand project entitled Analysis of Systems 
for Air Force Education and Training. Emphasis has been on the use of technology 
in designing ihetruction for formal technic^ training or for higher education, as at 
the Air Force Academy. The results will support the activities of the Director of 
Personnel Plans, Headquarters USAF; DGS/Technical Trau^ and tiie Training 
Development Directpiite, headquarters Air Training Command and the Air Force 
Human Resources Laboratory, espcmUy the Technical Training and Professional 
Education divisions. It will be of particular interest to .those working on the Ad- 
vanced Instructional iSystem. 

This report is pajrt of a continuing Rand effort to apply systematic methods of 
analysis and fiynthesis to i^^ and problems in education and training. Related 
studio have concerned Air Force pilot Ira^^ management of the pilot force, 
evaluatian o"^' programs oiP compensatoiy education, design of if^ormation systems 
for loc » L^uool districted and other diveroe concerns. A special bibliography of Rand 
work in education is available on requiast. 
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SUMMARY 



The Air Force expends several billion dollars annually on education and train- 
ing; in technical training alone, it spends over half a billion dollars and graduates 
more than 150,000 naen a year from five technical schools and numerous courses of 
on-the-job training. The high cost of traditional methods of technical training has 
stimulated Air Force research on new educational methods. Since i9iS8, Rand has 
been working on the design of instructional programs to help the Air Force, espe- 
cially the Air Training Command, to determine systematically the mix of instruc- 
tors, facilities, materials, and students that should go into its training and other 
instructional programs. 



RESULTS 

As a result of this work, Rand has developed MODIA (A Method of Designing 
Instructional Alternatives), a comprehensive methodology for designing an instruc- 
tional system. MODIA consists of a sequence of procedures and semiautomated 
''tools,^^ that allow a planner to examine many alternative instructional approaches 
before he puts ah actual system into use. He can rapidly plan a program for a 
particular i^proach and-Hstill at tihe planning stage-nassefis its utility in terms of 
production of graduates or consumption of human and material resourced. If the 
program is unacceptable on one of these counts, the planner may quickly construct 
and assess an alternative.approach* 

l%is report, one of a series of four, describes a unique and practical tool for 
instructional design-ni decision procass for developing teaching strat^es. It in- 
cludes two important elements: a Quastionitaire for Stating General Policy, and a 
computer-directed logic tree callsdi DISTAF (Determimng Instructional Strategies 
for Training in the Air Force) that helps the user plan in detail his teaching me- 
thodology for a given class. 

These elements and other tools are used in the MODIA process, which consists 
of eifi^t steps: 
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1. Analyze characteristics of tie learner population that will affect the way 
the course will be taught. 

2. Use the Questionnaire for Stafcing General Policy to specify the broad 
goals underlying the teachiA^* institution's operation. 

3a. Use the Curriculum Analysis Questio nnair e to typify each lesson in sys- 
tem-oriented terms and to characterize each lesson's requirements for com- 
munication media. 

3b. Specify instructional stratc^es with the help of DISTAF. Each strata 
identifies the teaching agent and tlte way students will interact with this 
teaching. 

4. Specify design criteria input from the teaching Institution, such as least 
course cost, shortest course length, or maximum student graduation rate. 

5. Descrijje Jocal resources such as the number of students entering the 
school and the school's resources and constraints. 

6. Design the instruction using as direct inputs information from the Cur- 
riculum Analysis Questionnaire, DISTAFF, the design criteria, and the local 
resource description. 

7. Analyze the costs to determine the system's time-dependent dollar re- 
quirements. 

8. As neces8aiy> depending on the acceptability of the outputs, repeat steps 
1-7 (with different inputs) until the most desirable system emeiges. 

Some migor tools must be developed before MODIA is complete, namely, a 
generalized computer model of student flo^ a computer model for estimating re- 
source reqmrements; and a questionnaire for detailing local resources. Although 
work remains, MODIA was tested manually on part of a basic still photography 
course at Lowry Air Force Base (described in R.i021-PR, cited in the Preface), 
allowing us to make three broad and important conclusions with confidence: 

• Systematic^ generalized methods cw be devdoped for designing pi^^ 
of instruction; 

• These techniques encourage ch«3 examination of alternative approaches to 
instruction; 

• A compx^hensive, q^inatic approach stimulates the development of in- 
sights into the design of instruction that would otherwise hot occur. 

The work has been directed toward vexy general applications so that it will be 
useful not only to Air Force organizations such as tiie Air Trailing Command and 
the Air Force Academy/but also to training and educational institutions in the 
public sector. 



SPECIFICS OF THIS REPORT 

The QuestionnaireforStetingGeneralPolii^con^ 
areas: the broad characterization cmT the teaching institution's goe^ the extent to 



which the schools will adjust to variations in the student popu? ;tion, and the way 
in which the schools must accommodate their operations to organizations that 
supply their students or accept their graduates. 

Once the planner completes the Questionnaire, he is ready to specify his in- 
structional strategies in detail using DISTAF. For its use, we constructed two aids: 
one is a manual presenting the strategy decisions the planner will have to make; the 
other is a time^hared computer program written in JOSS (Rand's on-line interac* 
tive computer system). 

The manual discusses the pros and cons applicable to each decision along with 
some of the logical consequences that will result from various choices. In itsdlf, the 
manual gives the planner a comprehensive checklist If he decides to use a very 
simple instructional strategy, he can proceed through the decisionmaking process 
at his own direction. If he wishes to specify a highly varied strategy, he uses the 
computer program. 

The program computesnothing. Rather, it keeps track of the planner's decisions 
and performs all the logical bookkeeping, which can be quite complex* Whereas most 
instructors use only a few approaches to instruction, DISTAF i)ennits specification 
for a single course of up to 57 different teaching strategies. This provides the planner 
with opportunities to take account of many different levels of subject matter diffi- 
culty, different student abilities, and requirer ^ts for different types of student 
perfonnance. To use the program, the planner sits at the computer console and 
answers questions of strategy as the computer directs him to do. At each point the 
computer refers him to the appropriate question in the manual to remind him of the 
arguments for and against each choice. 

While working throned the decision process, the designer makes the following 
kinds of choices: whether and to what extent to adapt course content to the students 
and on what basis to make the adaptation; whether and to what extent to adapt the 
teaching method to student capabilities to learn the subject; if he uses either kind 
of adaptivity, whether to categorize students into tracks or within^lass groups and« 
if so, how many. He also chooses how to schedule formal examinations, whether to 
make them objective or essay, and how comprehensive to make them; whether or 
not to schedule formal reviews and homework; what kind of learning experience* 
categories to use, such as classroom drill, laboratory practice, or demonstration; who 
controls the learning experience— students, instructor, or media; whether or not 
students must respond overtiy in some way— artswering multiple^hoice questions, 
writing answers in essay form, or perhaps peribrming some skill; and whether or 
not to give the students immediate knowledge of the correct response. 

The computer speed and program organization make it possible for the desifl^ 
to construct numy stratcigies in a relatively nH-^'t period Although he may take 
several hours for his first run, he becomes mere familiar with the decision pointo 
the time for a run will be reduced to irom 10 to 30 minutes, depending on the 
complexity of the strategy chosen. 

Although the decision process is intended to provide input for a semiautMiated 
methodology for HA«igt^mg instructional programs, it has several values in its own^ 
rifi^t: 
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It assists the planner in making explicit his judgments about what consti- 
tutes effective instruction. 

It assists the planner in stating policies that guide sdiool and classroom 
operations. 

It provides a comprehensive, logically consistent set of decisions that 
should be considered in planning instruction. 
For the first time, it <fescribes teaching niethods in terms that wiU 
the instructional prc^ram design. 



. 

vm 



A(X:NOWIJgaDGMENTS 



We with to thank our Rand colleagues, Rudy Bretz and Robert Petruachell, for 
na^T aanstance in developing the concepts and format of the DISTAF program* 
Their insight and patient support were essential to the work reported here. Our 
thanks also go to Erwin Gordon for helping us make the work comprehensible to 
others* Bfaijorie Rapp and Duncan Hansen reviewid the manuscript, which is much 
better for their carded reading and helpftil suggestions. Thanks are also due to 
Bemice J acobs, Maiy Jo Parise, and Roberta Schneider for their patience and expert 
assistance in preparation of the manuscript 



CONTENTS 



PREFACE • iii 

SUMMARY V 

ACKNOWLEDGMENTS ix 

FIGURES XV 

TABLES xvii 

Section 

L INTRODUCTION ; Jr^ 

General Approach 1 

Organization of the Report 4 

n. STATING GENERAL POLICY 5 

Goals of tJie Training Institatipn 5 

Adlpisting to Differences in Students 6 

Content Variations ; 6 

Method Variations ; 7 

Tracking and Grouping ; ; 8 

Scheduling - 8 

in. mSTRUOTONAL , 10 

Hovr til? Planiier S<^ Strati^ 10 

Cd^ories of los^ . , 12 

I Insb^^ i i ..... . 12 

T|pe IT lhiit^ : - • - • • ? • • • • - 14 

in lost^^ . ; , ... 15 

Discussion, Review, ..... i.. i . . , ♦ • 15 

Reiatiohdiip of D^ Other 



Systems of CLbue^^ 



16 




Strata Questions 18 

Adaptive Method CT'-Tj 19 

Variable Pacing • . j 19 

Presentation 20 

Relationship of Answers to Strategy Questions to Current 

Teaching Methods 23 

Lecture ' 24 

Recitation • 24 

Socratic 26 

Tutor 26 

Peer-Tutor 26 

Programmed Instruction 27 

Linear Programmed Instruction 27 

Branching Programmed Instruction 27 

Guided Discussion 28 

Interactive A::tivities 28 , 

Demoiistration-Performance 29 

IV. EFFECTS OF DJSTRUCTIONAL STRATEGIES 

ON SYSTEMDESIGN 30 

Student Flow ' 30 

Decisions Affecting the Amount of Material Each 

Student Must Learn 30 

Decisions Affecting the R^ular Class Time Set Aside for . . 

Basic Scheduled Instruction 31 

Decisions Affecting Student Learning Rate 32 

Personnel 33 

Media Materials and Programs/ and Instructional Aids 36 

/ ' Equipment 39 

* w ' Summary 40 

V. LOGICAL STRUCTiniE OF DISTAF. 43 

Strat^es for Scheduled T^pe I Instruction 44 

Presentation 44 

Variable Pacing rt.. 47 

Adaptive Method, Step 1 51 

Adaptive Method, Step n 51 

Fixed Schedule. , , 56 

/ Decision Sequence for Schedtiled Type I Ihstz action 56 

Strategies for All T^pe I Insira 56 

Wrap-Up of TVpe I ii!^ 56 

Exa^jnatioris and:Review.^ 62 

Strat^es for T^P^ H I^^ ; 66 

/r^-^-^^ Schediiled 1^ n I^^ 66 

I i y^yp^ n Ihstructioh, ihi^ Skills. . v ; 68 

/ xii 



Demonstrations of Models of Performance and Unscheduled 

Study, Individual Skills 72 

Wrap-Up Type of n Instruction, Individual Skills 72 

Type n Instruction, Interactive Skills 72 

Strategies for Type m Instruction 75 

General Strat^es 77 

Shortcuts in the Decision Process 79 

VI. CONCLUDING REMARKS 83 

Present Status of the Decision Process 83 

Present Uses of the Decision Process 84 

Appendix 

A. QUESTIONNAIRE FOR STATING GENERAL POriCTY 85 

B. USER^S MANUAL FOR SPEOFYING INSTRUCTIONAL 
SlllAmJIES 90 

C. PROGRAM OUTPUT FOR BASIC STILL PHOTOGRAPHY 

COURSE...;.... ; 130 

D. LIST OF VARIABLES IN NUMERICAL ORDER 138 

GLOSSARY 147 

BIBLIOGRAPHY 155 



xiii 



V 

1. The design process 2 

2. Logic tree n 

3. Air Force proficiency code for technical training 17 

4a. Decision sequence for presentation 45 

4b. Prcgram flow for setting presentation variables 48 

5a. Decision sequence for variable pacing , 49 

5b. Program flow for setting variables for variable pacing 50 

6a. Decision sequence for adaptive method, step 1 52 

6b. Program floW for setting tulaptivity variables (step 1) 53 

7a. Decision sequence for adaptive method, step 2 54 

7b. Program flow for setting adaptivity variables (step 2) 55 

8a. Decision sequence for schisduled 'type I instruction 57 

8b. Pn^gram flow for setting variables for scheduled Type I 

instruction 58 

9a. Decision sequence for all of Type I instruction 59 

9b. Pnjgram flow for setting variables for all of Type I 

instruction 59 

10a. Decision sequence for wrap-up of 1^ I instruction 60 

10b. Program S6w for sfsitting variables to wrap-up Type I 

instruction. 63 

11a. DecLnon .seqiience for examinations and review (Types I and 

n insteuctibn) ; ; 64 

lib. IVogram :flow for setting variables for examinations and 

reyiew (T^i^ I and.n iMtructioh). ..... .4, 65 

12a. Decisdoii sequence for m l^pe H instruction . . . ; 67 

12b. Vrogtam flow foir setting vai^ for sch^uled Type n 

instahi^^ ; ; 69 

13a. De^on: sequence ifor Ty^ U instructiori, individual skills 70 

13b. Prd^t^am fl^ for wtting yar^les for Type n insiriiction, 

ihdividU£d^^^£^^ .... . 71 

14a. Decision sequence for denionstration and unscheduled study 73 

XV 



14b. Program flow for setting variables for demonstration and 

unscheduled study 

15. Decision sequence, Type U instruction, interactive skills. 

16a Decision sequence for general strategies 

16b. Program flow for setting general strategy variables 




TABLES 



I lA. DISTAF Cat^ories of Instructioi^^; 13 

r IB. Example of Cat^orization Based on Student Learning 

} CaimbUity ..p: 14 

I 2. Relationship of Answers to Strata Questions to Current 



I . Teaching Methods. 25 

I 3. Values of Variables Related to Personnel Require 34 

I 4. Values of Variables Related to Media Materiiils 

I Requirements 37 

I 5. Effects of Strategy Variables on System Design 41 

6. Types of Instruction Matched for Decidmg Strata Changes 81 



xvu 



ERslC ^ ^ 



I. INTRODUCTION 



Since 1968» Rand has been working on the design of instructional programs to 
help the Air Force^ especially the Air Training Command, to determine {systemati- 
cally the mix of instructors, facilitiesrmaterials, and students that should go into 
its training and other inistructional programs. .As a result of that work, Rand has 
developed MODIA, a comprehensive methodology, for designing an instructional 
system. MODIA (A Method of Designing Instructional Alternatives) consists of a 
sequence of procedures and semiautomated "tools,*^ some of which have already 
been designed and are described m this series of reports. This report describes a 
decision process for developing teachinc.4 strategies. It includes two elements: a Ques- 
tionnaire for Stating General PoUcy and e computer*directed logic tree called DIS- 
TAF ODetermining Instructional Strategies for Training in the Air Force) that helps 
the planner extract the detailed implementation of his teaching methodology for a 
given class. 



GENERAL APPROACH 

To provide a context for the Qu^onaire and DISTAF, we briefly discuss our 
overall MODIA process step by step, as shown in Fig. 1. The process is intended to 
provide such characteristics of the ihshtiction^ as course lengUi; student 
flow; and what faciUties^ ecjuipment^ peb^inneli emd dol^ are heeded, and when. 
By means of MODI^ plfdmers to design an instructional program 

effidentiy and with cp|dSdence bdth that the outputs u«;acceptid[)ie to the teaching 
ustitution and that ^e methods of teaching the course are appropriate to the 
learners. The steps are described below. 

• Step i— Analyze the learner fiopulatidn in temis that will affect the wi^ 
the course is tau^t ^ ' - \* 
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Fig. 1— The design process 



• Step B^tate general policy mlxig the Questionnaire described in Sec. n 
and Appendix A of this report** 

• Step 3a~Analyze the curriculum using a branching questionaire that 
helps the user describe bis course in detail;* The Curriculum Analysis 
Questionnaire typifies each lesson (1) in cystem-oriented terms and (2) its 
requirements for communication media*' 

• Step 3b--Specify sM^te^ of instruction bb described in this report by 
means of piSTAP, a logic tt^ with eiach decision point a logical conse- 
quence of the prececiing decisions; To exercise it, the d^igher has two aids: 
an interactive, computer program written in JOSS/ and a User^s Manual 
that presents the pros and cons of decisions to be made at each point, along 
withtsome of the logical consequences of each choice. For each lype of 

* PoIiQT, as uaad'here, concenis the nature of the achool'a objectivee-whether it wants a itandazd 
a diverae output* and how it relates to inetitutioDS that uae its mduatea and those that aupply its 

students*^ ~ 

Nov^rferf' ^^^^^ (^tionnMrifbrO^ Corporation, R:102ipB, 

• RudyBrete,^^ Guide for Detign* 
m of Avr Fme Techueal TraimngPnig^^ Corporatioii, lUOl-PR, February 1971. 

1?? ^^^^ ^ JHiblished M i &ip^em<mt to this leporfc and eventuaUy will 

M translated mto Interactive FORTRAN. «~ • 



instruction identified in the Curriculum Analysis Questionnaire, an in- 
structional strategy specifies the teaching agent and the way students will 
interact with this teaching. 

DIOTAF encourages the planner to consider alternative methods of in- 
struction (up to 57 different teaching strategies for a single course) and to 
translate his decisions into guidelines for program design. This allows him 
to take account of different levels of subject matter diflSculty, different 
student abilities, and requirements for different types of student perform- 
ance. 

• Step 4— Specify design criteria input from the teaching mstitution, such as 
least cost, shortest course length, graduation of the most students per unit 
time, or maximtim use of communication media. 

• Step &--De8cribe local resources, presents data describing the rate of stu- 
dent entry and the school's resources and constraints, which will be gath- 
ered by means of a logically structured set of questions. 

• Step 6— Design the instructionalprogram using as direct inputs informa- 
tion from the Curriculum Analysis Questionnaire, DISTAF, the design 
criteria, and the local resource description. Indirect inputs are characteris- 
tics of the learner population, the stated general policy, and the general 
course features. 

At present^ we see four main components of this step. First, each lesson 
is linked to the instructional strate^ chosen for that particular cat^ory 
of instruction. Second, a set of criteria is used to select specific m^^dia and 
facilities. Third, a set of criteria is used to assign personnel Fourth, student 
flow through the course is simulated by a flow and scheduling model to 
generate graduation rates and resource requirements. 

• Step 7~i4m2/>7e^Ae ca5feto determine the i^ystem'stime<lependentdo^ 
requirements. This will eventually be accomplished by a computer pro- 
gram. 

• Step 8— As necessary, depending on the acceptability of the outputs, re- 
peat steps 1-7 (with different inputs) until the most desirable system 
emerges. 

Probably the most important single contribution of MODIA is that it encour- 
ages the examination of alternative instructional approaches. It helps the designer . 
plan a program for a particular approach rapidly, and-«tiU at the planning stage 
—assess its utility in terms of production of graduates or consumption of human and 
material resources. If the resulting instructional piogram is unacceptable on one of 
these counts, the designer may quickly construct and assess an alternative ap- 
proach. Providing this kind of feedback will help assure that many promising ap- 
prooches are explored; befiirt one is chosen for actual implementation. 
. Some maioT tools must be developed Wore MOC^ complete, namely, a 
generalized computer model of stodent Joi^ a computer model for estimating re- 
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source requirements; and a questionnaire for detailing local resources. Although 
work remains, we manually tested MODIA to demonstrate the feasibility and utilily 
of the design process; our example for the test is based on an actual course in etill 
photography taught to enlisted airmen in the Technical School at Lowiy Air Force 
Base.' 



ORGANIZATION OF THE REPORT 

Section n describes the Quecti.onnaire for Stating Gereral Policy, presented in 
Appendix A. The remamder of the report deals with several aspects of specifying 
instructional strategies in detail. First, Sec. m describes the strategies available to 
the planner. It also diows how these are related to the teaching methods of everyday 
educational parlance. Next, the effects of the various instructional strategies on 
system design are discussed in Sea IV. Section V then describes the logical structure 
of DISTAF , the interactive logic tree, and will be of particular inteieet to anyone 
concerned with the details of the DLSTAF program* Ooncluding remarks are given 
in Sec. VI* In addition to Appendix A, mentioned above. Appendix B contains the 
User's Manual for Specifying Instructional Strat^es, which is used in coiyunction 
with the DISTAF program. Appendix C displays and discusses the instructional 
strategy as output by the DISTAF program.for the basic photography course men- 
tioned above. And Appendix D contains a list of variables. 

• R. L PetmeheU and PoUy Carpenter, MODIA Applied in the Deeign and Co$tAna!y$i$ of an 
Innovative Av Force Insttnictional Coum^ The Rand Corporation, R-1021-PR, November W2. 
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IL STATING GENERAL POUCY 



Ground rules for designing an instructional program fall into two general 
eateries— polipy and strategy* Policies concern iouunly the very broad goals under* 
lying school operation, strategies concern how to carry out these policies^ As in« 
dicated in Sec* I, the explicit statement of policies guides the specification of instruc- 
tional strategies* 

In the Rand work, we consider policies in three general areas: the broad charac- 
terization of the teaching irjstitution's goals, the extent to which the schools mil 
adjust to variations in the student population, and the way in which the schools must 
accommodate their operations to the needs of organization that supply their stu« 
dents or accept their graduates (scheduling)* To assist the planner in stating these 
policies, the Questionnaire for Stating General Polipy (Appendix A) was constructed* 
It is tied to the analysis of student population and provides input variables for 
DISTAF* 



GOALS OF THE TRAINING INSTITUTION 

We discuss the Questionnaire as it reUtes to the three areas mentioned above* 
Answers to the first two questions provide a very general characterization of the 
institution's goals* 

1. Will a standard number of instructional hours be required as input, re- 
gardless of course content or atudrnt capability?* 
2* Are standardized graduates desired? 

First, the planner indiMtes whether the teaching institution 
ard number of instructional hours'* for every student This type of requirement is 
legally mandated for public schools in many states, is required in most institutions 
of hi^r education,'and is also prescribed in many training programs for labor 

* IteiBtdaAiiaditttbeGldtMzx^tpMrm 
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union membership. Because our concern has not been primarily with such institu- 
tions, at this point a "yes'' answer to question 1 would halt the design process 
(although relatively few modifications will be needed for the process to reflect this 
general policy). A "no" answer sends the designer to question 2. 

Question 2 deals with whether the planner wants the graduates to be as similar 
as possible (standardized) with respect to their mastery of the course. No one be- 
lieves, of course, that it is possible or even desirable to produce graduates who all 
have exactly the same level of mastery of the same set of skills. Air Training 
Command poliqr at present, however, devotes no additional resources to helping 
more capable students attain higher levels of masteiy; rather all students are 
expected to master a given minimum set of objectives. Such a policy certainly 
alleviates problems of personnel assignment, but may stifle the curiosity, initiative, 
and creativity of the better student Professors in the Air Force Academy who would 
wif h to develop the potential of each conunissioned officer to the fbilest would 
probably reply positively to this question. 



ADJUSTING TO DIFFERENCES IN STUDENTS 

Content Variations 

Question 2 also relates to wiations in the student population. If students are 
relatively homogeneous, it makes little difl'erence whether a standardized graduate 
is desired. If they vary widely in their capabilities to master the subject matter, 
however, those with better capabilities may be expected to master a laxger set of 
objectives than the average Si^udent in order to develop their potential more ftiUy. 
Therefore, the designer is asked: 

3. Will better students be encouraged to go beyond average achievement? 

Additional objectives can Xiao help keep the bright student from becoming bored. 
Similarly, students witii iow^r cafttbilities may be expected to attain a smaller set 
of objectives, a set from which work that is not essential or too c^enging has been 
deleted 

4. Will requirements be relaxed for poorer students? 

Students who have difficulty in learning the subject will work as hard .to attain 
a limited set of objectives as will the average students to master the standard course 
materials* Similarly, brie^t students may quickly master and become bored with the 
standard course and may need the challenge of additional objectives. Although this 
tactic equalizes, to some eitent, the demands placed on the students, it may result 
in inequalities in student learning that compound over time. 

The replies made to questions 3 and 4 will afitet both student flow and the 
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Curriculum Analysis, in which learning events required for enrichment or those 
that can be deleted must be identifi^ and- described. 

Will exposure to course contentl)e matched to prior student achievement? 
Will additional instruction be given to students who are deficient in course 
prerequisites? 

Will students with superior preparation be allowed to skip topics they 
already know? 

*Tes" answers to questions 5 and either 6 or 7 will have similar effects on student 
flow and the Curriculum Analyus. If question 5 is answered ''y^" however, course 
content is to le adapted (ndaptivity) to the student's prior preparation for the 
course. Those who are deficient in course prerequisties may be given remedial 
instruction (question 6) or those with superior preparation may be allowed to skip 
topics they already know (question 7). DISTAF later provides the designer with an 
opportunity to specify at what point and how to identify such students. 

Adapting course content to prior student learning primarily affects the effi- 
^ency of instruction, as it is directed toward teaching students only what they need 
to learn to master the course objectives* It may be adopted whether or not standard- 
ized graduates are desired and wiU be most uaeftd in situations in whic^ 
population has highly diverse backgrounds. 

Method Variations 

8. Will different instructional strategies be designed to match dififerent stu- 
dent capabilities? 

9. Will special strategies be used for better students? 
10. Will special strategies be used for poorer students? 

Questions 8 to 10 determine whether the designer wants to take student capa- 
biUty into account in choosing instructional methods. (Stu&nt capability is a mix- 
ture of motivation, innate ability, and prior achievement) lliis is a crucial step, 
particularly for a highly heterogeneous student population. 'Tes'' answers here 
determine how much variety in method and matmials will be supplied In the usual 
classroom, such <2ecisions are left to the instructor who must assess the 
heterogeneity of his students and, usually through trial and error, reach them as 
best he can. Even the most competent instructors can be stymied by a highly hetero- 
geneous class and a limited set of materials* 

Variations in method may consist of breaking subject matter into small steps 
for the slow learner, challenging fast learnen to discover principles for themselves, 
allowing slow learners more time on a particular topic, or I'Hting fast learners direct 
their own study independent of an instructor. DISTAF permits a wide range of 
variations by taking the planner throu|^ the process of setting strategy for each 
ability grouping he wishes to consider for various levds of subject matter diflkulty. 

The planner's decisions about which levels ofstudentc^wbiUties he 
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conaider separately are clearly influenced by the distribution of capabilities he 
expects in the student population. Policy considerations also influence his dedsions^ 
for example^ whether Uie community will be friendly or hostile to special treatment 
for the fast learner. 

Tracking and Grouping 

To make it easier to adapt either method or content to various characteristics 
of the student population^ fi^uently students are put into gMupa that are rela- 
tively homogeneous with regard to the characteristics of interest Each group may 
then be taught diflTerently either by using diffimnt methods or by spending differing 
amounts of time in teaching them> or by combinations of both techniques. Students 
may be put into groups whose members may change from time to tiine, depending 
on the instruction. 

Alternatively^ tracking (tracks) puts students into classes whose members re- 
main essentially the same throui^out the course; in dfect, separate but parallel 
courses are taught Tracking may have undesirable psychological effects on both 
instructors and students, but it permits a greater concentration of .^nmrces on the 
learner and may result in a higher overall level of leuning. Within-dass grouping 
makes greater demands on the instructor's ingenuity. 

11. Will studezitu be put into tracks? 

12. Will students be put into tracks on the basis of their learning capabili^ 

13. Will studen^^ be put into tracks on the basis of their preparation for the 
course? 

Since tracking affects the entire course and may be a matter of poli^» the 
designer is asked in question 11 whether he will use it If so» he then establishes in 
questions 12 or 13 the bosis for track formation, depending on the types of adaptivity 
he has previously chosen^ If he chooses only one basis, say student learmng capabil* 
ity, his prior answers to questions 3 and 4, for example, will be sufficient to direct 
the formation cf tracks* If he chooses two bases, be will use his analysis of student 
population and the types of adaptivity he has selected to guide him in forming the 
tracks* The number and type <^track£ formed wiU then be input to DI^ 
instructional strategy may be apedfed for each track. 



SCHEDULING 

When a standard number of instructional hours is not required as input, it is 
possible to save time and other respuroes by encouraging average 
to graduate more quiddy than slow learners* In additum to being more effideht, this 
tactic may give the student a greater sense of con^l over his own learning and, 
hc^iefblly, encourage the devdopment of responsible attitudes. These advimtkges 
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may outwei^ the disadvantages of greater administrative burdens and greater 
demands on teacher inventiveness. 

Most instruction, however, is designed so that all students will learn certain 
basic sections of course content on a fixed schedule. This simplifies such tasks as 
scheduling tests, assigning teachers and classrooms, predicting the availability of 
graduates, and ordering supplies. And, if wisely managed, there can be a fair amount 
of adaptivity within what is sometimes called Iock-«tep instruction. Moreover, the 
user of the graduates may want them supplied in predictable numbers at r^ular 
intervals, as is the case in the Air Force personnel system. Thus, it is important to 
consider whether students must master course content on a fixed schedule so that 
the user will be predictably supplied. 

14. Will basic course content be presented on a fixed schedule? 

15. Will additional resources in the form of remedial instruction or washback 
be used for slow students or students who haye been absent? 

16. Will failing students be dropi^ from tlie couree before its conclusidn? 

17. Will baric course content be presented on a fixed schedule withih t^^ 

Question 14 applies if no tracking is being iised; question '17 implies to tracking. 
It may be considerably earner to meet the user^s requirements and still accommodate * 
student differences if tracks are used witii a fixed schedule for each track. 

If fixed scheduling is used, examinations are given on a fixed schedule, and 
students who do poorly on tlie test inust either take remedial instruction to make 
it up, repeat the material covered, or be eliminated froni the course. Additional 
resources are also needed to catch up students who have had excessive absences. 
Therefore, question 15 allows the planner to specify whetiier he wishes to provide 
additional resources for these purposes. Additionally, students who are failing may 
be dropped from the course before its conclusion (question 16). This saves both 
instructional resources and student timel 
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in. INSTRUCTIONAL STRATEGIES 



This section provides the reader with a general understanding of the process for 
specifying instructional strat^es. It begins by desaibing the planner's role. The 
process is structure! around a framework of categories of instructiohal activities 
classified according to the teaching resour^ inherent in the subject matter/ the 
eateries are described and then compared with other, current systems for classify- 
ing instruction. Within each category, questions are asked whose answers establish 
the detailed features of the teaching strategy to be used. Some strateg^ questions 
and answers are then described. The section ends by showing how some sets of 
answers to the strategy questioiis relate to current teaching methods. 



HOW THE PLANNER SETS STRATEGY 

Once the plaimer completes the Questionnaire for Stating General Policy, he is 
ready to specify his instructional strat^es in detail using DISTAF. For its use, we 
constructed two aids: one is a manual presenting the strategy decisions the planner 
will have to make; the other is an interactive computer program written in JOSS 
that g uides him through a logic tree. 

The manual discusses the pros and cons applicable to each decision along with 
some of the logical consequences that will result fh)m various choic^.'Ih itself, the 
manual gives the planner a comprehensive checklist. If he decides to use a very 
simple instrudipnai strata, he can proceed through the decisionmaking process 
by himself. If he wishes tx> spe(^ ;a l]d^ varied strata, he us^ the coniputer 
program. The program computes nqtl^ng. I^^ it keeps track of the planner's 
decfaibns and performs all the Ic^cd bopl^eeping, which can be quite complex. To 
use the program, the plcuu^r.dte at the 6pmptitera)nso and answers questions of 
strata as the computer directs him to do. At c^ch .pom^ the (x>mputer refers him 
to numbered questions in the manual to :reinind -h^ arguinents for and 
against each choice. 

The logic tree is based oh three typfs of inrtrac^o^ that provide a framework 
for the DISTAF process. At branch iwints, each category of instruction may be 
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divided into several subcategories, some of which are shown in Fig. 2. For each 
subcategory of instruction included in his course, the planner specifies a strategy by 
answering a set of questions. Thus, whereas most instructors use only a few appro- 
aches to instruction, DISTAF permits specification for a single course of up to 57 
different teaching strat^es, one for each subcategory of instruction. This provides 
the planner with opportunities to take account of many different levels of subject 
matter diflSculty, different student abilities, and requirements for different types of 
student performance. 

It will probably take a user several hours to make'his^first run through the 
DISTAF program. As he becomes familiar with the decision points, however, this 
time will diminish to from 10 to 30 minutes, depending on the complexity of the 
strata chosen. 



Major types Amount of 

of Shident-to-shjdent student 




Fig. 2— Logic tree 
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CATEGORIES OP INSTRUCTION 



Let U8 now examine the three mcgor estrones of instruction.^ Type I instruc- 
tion does not require students to develop skills through drill or practice. Much 
conventional classroom instruction is of Type 1. Type n instruction requires 
students to develop skills through drill or practice but does not require them to work 
with special equipment or in special facilities. Thus, Type n is also classroom 
instruction. Type TEL instraction requires the students to work with special equip- 
ment or in a special facility, which nieans elsewhere than in a classroom or carrel. 

As shown partially in Kg. 2, each type of instruction is divided into the sub- 
cat^ories shown fully in Table lA. Each column (1 to 7) indicates a ha^ on which 
subcategories are formed; each also may influence the way in which subcategories 
to its right on the table are chosen. Shaded boxes indicate some subcategories whose* 
formation is not subject-matter dependent^ such as unscheduled instruction 
(homework). The shaded boxes are included because the avail£d>le choices of answers 
for the strata questions at Uie finest level of detail depend on these categorizationiL 

The numl^r and type of cat^rizations that the user chooses to call out on the 
basis of student learning capability (column 6) are related to the type of instruction 
and its level of difSculty . Generally accepted learning-capability categorizations are 
as follows: 



The user may choose different categorizations at different levels of difficulty, as 
suggested by the example in Table IB. 

The requiiemeht of the subject matter for constructed response (a response 
the student devises himself-^lunm 7) would seem to have a small role or no role 
to play in the judgment about the nmnber of categories of student learning capabil« 
ity chosen; hence, column 7 is to tiie right of colunm 6.^ 

Type I Instruction 

For convenience, each subcat^ory in Table lA is assigned a line number (last 
column), to which the following discussion refers. TypB I instruction (lines 1 to 3) is 
hot subcat^orile^ on the bads of requirements for studeht-to-student interaction 
or student perfonoance because, by defini^qn, l^pe I instruction is not intended 
to teach skiUs. 

Unschediiled Type I ix&structiqn (ancfwefed ''no,'' line 1) is traditional homework 
and has been treatediyery ed^ have not a^^ the desi^er to a^ign a level 
of <Mcidty to ta^^ this instruction to student learning caimbilities (to soihe extent, 
tlie student does tins cutiyway), or to dbncdder requirements for special presenta^ 

* The GloBsary OMKtuiif fUUer dalcriptioDS ciihib thrae ^rpes of instnictioiL 



1 group. 

2 groups 



no categorizatiGn 
alow and average-to^ric^t or 
fllow-to^verage and bright 
fllow» average, brifi^t 



3 groups 
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Table U 
DISTAF CATEGORIES OF INSTRUCTION 
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Up to 3 


M.C. 
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Difficult 


Up to 3 


M.C. 
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Mo 


Simple 


M.C. 


M.C. 


4 
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(aodel of atudent 
parforwmce) 


Cofl^laK 


M.C. 


M.C. 
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Yaa 


Simple 
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M.C. 
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Complex 
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M.C. 
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Complex 
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Up to 3 


Yaa 
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Kined 
(follow-me inatruc- 
tion) 


Mo 


M.C. 


M.C. 


M.C. 
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Yaa 


M.C. 


Up to 3 


M.C. 
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(interactive 


Ho 

(model of interactive 
performance)' 


M.C. 


M.C. 


M.C. 


M.C. 


18 




Yea 

(interactive perform 
mance) 


M.C. 


M.C. 


M.C. 


M.C. - 


19 


Type 111 


See Type II inatructlon Md tM(t deacriptfoa.of Type III iiiatructioa< 




20-35 



^.^V 5^ •"*>J«ct aettar raquirea etudenta to interect With eech other becauaa.they ere leamini interactive 

(ea in cloae-ordar drill or craving an aircraft)* thia colwmi la anawered "yea.« Otherwiac. it ia 
anwered "no/» even If etudenta interect with each other during the inatructlon, ea in email croup diacuaaiona 
or directed cleaaroom drill; 

If the aubject matter, requircli^etudcnta to perform in order to Icem e akill, thia column ia anewercd "yea." 
unltaa^ehe inatruction compriaci the preaentatlon of a wdcl^of the akiU to be' leaned. Zn that caae» tU enaver 
ia either 'no" or >ixed/* depending on whether.the'etudent obecrvee the prcaentetlon without performing or follbwi 
the dcmonat ration •tcp-by-etep* 

^•^'^^y. kww* indicate policy- dependent aubcategorlaatlona» ee oppoaed to thoae that ere 

eubject»mattar dependant. " 

A ' ^' ' . 

H'^^T-T*'**** o« iMtructlon le to be adapted to etudent laexmikg capability, DISTAT allova^the planner to 
apeclfy different etretegUe for up to thxme categorlee^oretudemte. If, :f or axi^ lei three cetegories are 
uaed,.e aubcategory torthe, right U trlplaa. :4a;axaipU la ahoiCin Table U« 

•m.C. i^ana that tha^liwtructiom le>t aubcategorlaad om thia baela. Zn'aome Inatancae, the planner muet 
eaaign a alngle value to thia varUble; in othera, the varUbla le eeaumed Irrelevant. 
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Table IB 

EXAMPLE OF CATEGORIZATION BASED ON STUDENT LEARNING CAPABILITY^ 



Column Nuaber fros Table lA 
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Type of 
Instruct Ion 


Scheduled 
Instruction 


Level of 
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Line 
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Table U 
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N.C. 
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1 






Easy 


Slov 


2 


Type I 




Average-to-brlght 


2 


Yes 




Slov 


3 






Difficult 


Average 


3 








Bright 


3 



Only Type I considered; colunns N*C* for all Type I deleted* 
Had the. user wished, he- could have chosen 3 categories of student 
learning capability for line 2* 



because all presentations must be recorded for student use* We do aski however, tiiat 
he designate the type of response (if any) to be elicited for all instruction in this 
category. 

Scheduled IVpe I instruction (lines 2 and 3) is traditional classroom instruc- 
tion (although the planner^ choices may make it necessary for the students to work 
in study carrels at a learning center). If the planner wishes to elicit overt responses 
from the students during this instruction, he chooses the type of response (column 
7) for all instruction in each of up to the six cat^bries that may be formed on the 
basis of student learning capability. 

Type n Instructibn 

Because unck^heduled n instruction (also traditionial homework) can apply 
to such diverse activities as pra^cmg additioh or writing a term piper, it is broken 
into seven subcat^ries, as shown in Im 4, 5, 8 to li, and 16./It is hot, however, 
categorized on the ba^ pf stiident l^iiuhg oap^ ipeciudfp re* 
qukemehts. Whatiever pr^^ must b^ ^ade would c6n£^ of stimuli for drill, 

problems f^r i}luti6h, ordii^ all ^.wMdi wpi^^ stiideht jperforinance 
(lines 8 to 16); or (rf; showing a iaipdel of the sldU t«^^ to 7 and 16 

and 17). • 
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If students do not perform the skill during the showing of the model Qinm 4 to 
7)» the instruction is not subcat^orized on the basifi of student learning capability 
and no decision must be made concerning the type of response. If students do 
perform the skill during the showing of the model (lines 16 and 17), constructed 
response is assumeii to be required. Follow-me instruction is assumed useful only 
with complex skills, so it is not subcat^orized by level of difficulty, but may be 
subcat^orized by student learning capability. 

Type II instruction may teach interactive skills such as dramatic production or 
debating (lines 18 and 19). The Curriculum Analysis provides most of the data for 
determining what configuration of facilities and personnel is needed for these 
cat^ories. No unscheduled instruction is included on the assumptfon that the re- 
quirements for assembling a team or gr6up will force the instruction to be scheduled. 

* 

Type m Instruction 

The subcat^rizations of Type HI instruction (not shown explicity in the table) 
follow those of Typcf n very closely, although ^e reasoning behind them is some- 
what different Because TyP^ m instruction concerns the development.of student 
skills in working with spedal equipment or in special facilities, all presentations 
(except brief directions) require special facilities or equipment This breaks the 
**mixed'' cat^ory of I^pe n. instruction (lines 16 and 17) into two subcat^ories 
depending on intent (1) it is true fi)llow*me performance vrith each student copying 
a demonstration as it is presented, or (2) the students are only following step4)y-step 
directions. In the first case, a model of performance must be prepared and carried 
out; in the second, such a model is not used. In either event, each student must have 
access to the required facilities or equipment during the presentatbn. 

Discussion, Review, Examihation 

DISTAF treats several eateries of instructional activity that are not entered 
on Table lA: review sessions, formal exaniinations, scoring of student work, group 
discussions, and student-instructor discussions. The configurations required to 
carry out these activities can be derived from decisions the planner makes in using 
DISTAF ir coigunction with the Cuniculuna Analysis. These decisions are discussed 
in Sec. V, which dwaibes the logical structure of DIST^ in detail; 

The term learning eyent, a I^y concept in sy^m design, refers to any instruc- 
tional activity that can be assigned to one of the subcat^ories in Table lA. A dngle 
class session will usually contain several learning events. For example, teaching a 
typingskOl may involve an mtroductoiy talk or difiknission (Type li scheduled^ easy), 
the presentation of a model of peiformance CI^P^ in, modelof student perforaiance, 
scheduled, simple), a foUow-me dembns^tion (TVpe in, mixed, scheduled, simple), 
and^ practice sesdon CIlj^^I^^ scheiuled, cample). If a particular 

instructional activity seems to lie a nuxti^ of more thim one siib^t^oiy, it should 
be subcat^oriz^ as in tl^ abdve excmple./tt' i^ result in many learning 



15 



events, each of very short duration (say less than five minutes), the activity should 
be assigned to the category that requires the most resource support Generally, this 
is the eatery with the higher line number on the table, (Unscheduled study, of 
course, will be easily separable from scheduled instruction.) 



RELATIONSHIP OP DISTAF CATEGORIES OP INSTRUCTION 
TO OTHER SYSTEMS OP CLASSIHCATION 

At first, it would seem possible to use one of the existing taxi momies as a scheme 
for classifying instruction. Why was it necessaiy to devise a.pew i^ystem from 
scratch? The answer is that none of the nuyor classification systems relate what is 
being taught to its inherent resource requirements* Hence, n^eWi form a basis 
to guide the frmctional design and resource analysis of instructional systems. 

Let us look briefly at three existing structures to illustrate this pomt: Bloom's 
Taxonomy of Educational Objectives, • Gagn^'s eight types of laming,* and the Air 
Force Proficiency Code for technical training*)^ Bloom's miyor eateries of educa* 
tional objectives ore based on educational and pfiychological considerations: cogni* 
tive, affective, and pqrchomotoh Cognitive and affective cat^ories may or may 
not require overt student performance and may or may not be c!assit)om instruction. 
For example, cognitive skills or knowledge are used heavily in troubleshootmg a jet 
engine (Type m instruction), in aolying arithmetic problems (Type n instruction), 
and in gaining an understending dV the causes of the Civil War (Type I instruction^ 
Affective objectives naay also be sought in any of the three types of instniction. Only 
p^chomotor objectives cannot be taught in I instruction. Handwriting, for 
example, is a ^chpmotor skill taught in T^P® H instruction* 

Gagn^'s eight ^rpes of learning are based on considerations of the psychology 
of leiarning: signalleaming, stiniulus-response learning, chaining, verbal^assodate 
learning, multiple discrimination, concept learning, principle learning, and problem 
solving. Some of these, such ias problem solving, require overt student performance 
and hence cannot occur in T^ype I instruction. All of them may or may riot require 
special facilities or equipment 

" The Air Force I^x)ficien<y Code, reproduced 
gorization we use but is mtended to indicate the relation of the knowledge and skills 
to the Air Force specialty. Therefore, it does not go far enough in subcategorization, 
because, for example, it makes no dktinc^ basis of level of difficulty or 

type or response required* Mort mportahtly,^/^^ perfomumceis riot distinguished 
by.whetiier or not it requim or equipment 

We grouped task Jmowledge and subject knowledge as l^pe I instruction Csince 
they do not require rtude perfonn|mce), a^^ of task knowledge can be 

^R ltOH^ IV^^^ ^ Nar YoA, 1966. 

TJlJt!^!^l[!^^ Mmidan, STS 45230/60/70, 

l>n«im«t of ths Air Foi^ 
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fiOriCIINCY CODE KEY 




•CALt 
VALUt 


DEFINITION: Tlie Iftdmdvftt 


w 

u 

V i 

^ i i 

" 1 5 

w 
ft. 


1 


Caa do siMfle f§if of ilie cstk. Needs co be lold or obowo Imv co do oiosc ol iW cook. 

(EXTREMELY UMTEO ) 


2 


Coo do most p«ns of tke tssk. Needs lielp ooly oo kftrdesc fens. May soc oMet locst deoMftds for 
speed or tccofscy. (PARTIALLY PROFiaENT) 


5 


Cos do all ports of tlie cftok. Ne<:da oaly a spot ckeck of coayUted arork. Ncef a oaaiatoai local 
de»aada for apeed aod accoracy. (COMPETENT) 


4 


Caa do the cooflete task ^akkly aad accurately. Caa tell or ahov ottcera liov to do tlie tuk. 
(HIGHLY PROFICIENT) 


w 8 ^. 

I i i 


ft 


Caa fta«e parts, tools, sad ataipio facts akoot tlw task. (NOMENCLATURE) 


b 


Caa oaae the ateps ia doift| tke taak aad tell boar eack ia doae. (PROCEDURES) 


c 


Caa esptala.wlip and vrkea tke taak awat be doae aad wby eacb atep ia fteeded* 

(OPERATING PRlNaPLES) 


d 


Caa predict* ideatify* aad reaelve probleaM about the taak. (COMPLETE THEORY) 


S 8 3 
1 ' i 


A 
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Caa evaloate coaditiosa aad «ake proper decialoaa abase tbe adbyect. (EVALUATION ) 
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transmitted during the presentation of performance models in Types n and m 
instruction. 



STRATEGY QUESTIONS 

Strategy questions are asked for each instructional category included in a 
course. In this section we discuss only questions that apply to basic scheduled 
instruction" because this is the category for which most planning traditionally is 
carried out Two criteria guided the choice of questions and answers: 

• , It should be possible to describe any teaching method of current interest 
by giving appropriate answers to the questions; that is, the questions 
should be comprehensive. 

• It should be possible methodically to derive an instructional program that 
could implement the strategy described by any set of answers. 

We demonstrate subsequently th it each mterion is satisfied, at least in part, by the 
questions and answers chosen. 

Whenever the designer makes a H^sr usi^ DIS'fAF, he enters a number 
corresponding to his decision (as indicated _ the User's Rfanual, Appendix B) into 
the computer. The computer then assigns that value to the variable corresponding 
to the given decision. We call this a strata variable. After completing a run 
through DISTAF the instructional strategy becomes, in iissence, a set of specific 
values (each value corresponding to an answer the user made to a question) that the 
computer assigns to variables and compiles as the user progresses through the 
decision process. The set of answf^rs describes a stratefiy of instruction in terms that 
will direct instructional program design* The product of DISTAP, then, is a specified 
instructional strategy, not a specific instructional {Mrogram. (The process for tran- 
slating instructional strat^es into the instructional programs needed to carry 
them out is still under development, as discussed earlier.) 

Before proceeding, it will be kelpM to recall that a n^jor premise of the Rand 
work is that the content of instruction has ahready been determined; that is, the 
design process does not deal with matters of content or content emphasis. So there 
is no explicit treatment of such questions as: How much time should be spent on 
fundamentals as opposed to handaon performance? How frequently should a skill 
be practiced for long-term retention? Should explicit efforts be made in the class- 
room to moti^te studient involvement with the subject by including pep talks, 
orientation sessions, and the like? These quertions will be addressed in a systematic 
fashion in tibe fixtme; bwause of the Air Foi^ work miqartemitt of instruction, 
they are not treated here. 

. J* ^!f*^ becauie it it intebdad mihteottot thelbtniiiig proom (•-imiif^ of 

Decftuie it it cvned out at a pradeterminad time and pUict (uaually raforred to m ^'during dam hou»*0. 
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Adaptive Method 



For convenience, we distinguish between adaptive method and adaptive con- 
tent In general, there is no clear dividing line between the two types, although 
different approaches can certainly emphasize one or the other* At present, DISTAF 
is primarily concerned with allowing the pLiBnGr to adjust the method of instruc- 
tion to students' learning capabilities* For scheduled basic instruction, DISTAF 
allows Uie planner to specify strategy for both betweeibsewion and concurrent 
adaptivity* In between^session adaptivity an instructor, a computer program, or a 
tutor analyzes each learner's performance during previous instruction and chooses 
the particular technique to use for the next session of instruction* In concurrent 
adaptivity, the method of instruction is adjusted to each student's needs while the 
instruction is in progress* 

The planner first designates how students are to be grouped on the basis of 
learning capability* This decision is heavily influenced by the analysis of the learner 
population that precedes the use Of DISTAF* An instructional strategy is then 
specified for th^ students in each group* When making the grouping decision, the 
planner may treat each student as an mdividual, that is, adapt the instructional 
method to each student's learning capability* 

Next, the planner designates the adaptive agent (adapter) for each group or for 
all individuals* The adapter may be an instructor, a student leader, the individual 
student,^* or an adaptive 

An adaptive program directs the student's study as he progresses through the 
material on the basis of his demonstrated mastery of the material* Such programs 
are usually presented by a computer and always mvolve branching of some form; 
that is, at certain points students are shunted along dififerent paths depending on 
their reactions to the preceding material! Scrambled books or other media that 
indicate branching are not adaptive programs in the fUU sense because the user 
must perform the actual branching* A scrambled book, for example, will direct the 
reader to different pages depending on his answers to a question* The adaptive agent, 
in this case, is partly the book and partly the reader because he may choose not to 
follow the directions exactly* 

If students are grouped by learning capability, DISTAF gives the planner the 
opportunity to specify a different adapter for each |[roup, if desired* If students are 
treated as individuals, however, the adaptive agent is assumed to be the same for 
all students* 

The rest of the variables specified if the method is adaptive are described under 
ftesentation, which follows the description of variable padng* 

Variable Pacing 

Even though the method of instruction may not be adapted to student learning 
capabilities in general, the rate of instruction may be matdied to student learning 

» Students who are afd wni c ally ao^iktkatod irodi m graduate attidents) are often tbeir om 
adepCera. 
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rates. This is called variable pacing and is effected by determing whether the student 
has mastered each learning objective before proceeding to the next This adjustment 
is always made concurrent with the instruction. (Note that variable pacing is im- 
plicit if the method is adaptive.) If the planner decides to use variable pacing in an 
instructional categoiy, he chooaes the controlling agent (pacer), which may be an 
instructor, a student leader, an individual student,.or areapoiiaei»aoed fnxigram. 
Are6ponsei)aced program is similar to an adaptive program excei^ that it contains 
no branches and varies only the rate of presentation. Most teacliing machines 
present response^paced programs. 

The pacer may match the rate of instruction to the learning rate of a single 
student or to the average learning rate of a group of students. The planner may 
choose the latter tactic to save money if he feels enough students will have similar 
learning rates to group them without losing the benefits of variable pacing. If the 
learner is his own pacer (self^padng), this type of grouping is not possible, of course. 

The rest ofthe variables specified ifvariable pacing is used are described M 
under PrmntaHon. 

Presehtatioii 

There are six primary strategy viuiablw presenter, ba^ 
titrated stimuli, recording responses, typ^ of response, and feedback to learner. 
Each is discussed in turn. 

Preaenter. DISTAF emphasises variables that direct the design of communi* 
cation media qmtems for instruction. Therefore, a primaxy variable is the presenter 
of information, of directions for student performance, of drill stimuli, or of a demon* * 
stration of a skill that students must master. 

For basic scheduled instruction the presenter may be an instructor, a student 
leader, any appropriate oraimmiication madiuin, a flxedMurmtioii program, an 
adaptive program, or a responseiiaced program. Some of these terms are nowdis* 
cussed* An appropriate communication medium is one that can convey the sub- 
stance of the presentation: it is chosen for each topic from data supplied by the 
Curriculum Analysis. 

A fixed-duration program is one whose time for presentation is not intended to 
be affected by the students.. Anything that ^Vuns,"* such as a film or audio tape, is 
a fixed-duration program unless spedai equipment is added to control running time. 
Fixed-duration programs simplify scheduling and are useflil when students must 
attain some minimum speed of perforaiahce. 

The adaptive prqgnun ax^ the response*]^^ program are used to adapt the 
method or pace of a presentation Iqr any appropriate communication medium to the 
students' learning capabilities. The ^ptive program is an option if adaptive meth* 
ods are used; the response-pa^ prbg^^ available for variable pacing. . 

If ti^ learner is his omi padnr, he must be sd with the appropriate com- 
munication media and ii^atevw medu^ heed to control them. If the 
medium needed is ihe printed page, no additional controls are requued; if the 
medium needed is ^t wmUd normally be presented by a fiimMuration program, 
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s;op and start controls must be provided to permit the student to pace the preMnta* 
tion as he desires. 

Similarly, iftheleanier is his own adapter, he must be given internal random 
access to the materials. In the case of nornmlly fizednluration programs, this means 
that the student must be able to stop, start, fast-forward, nnd fast-revene the pro- 
gram at will and that the program must be coded so that he will know where to 
advance it to or back it up to. 

Background Bfaterials. Materials are provided to support (or cany the bur^ 
den oO instruction except when the presenter is an ia^tructor and the planner 
explicitly chooses to rely on him to gather and prepare his own materials and 
instructional aids, such as chart* ^r transparencies* The planner can choose special 
kinds of materials to support instruction by an instructor, student leader, or learner 
(self^instructionX They are: a programmed guide and stratified materials, Le., 
modularised matwials prepared at several levels of difficulty. 

Integrated StimulL If a student is paying attention to the instruction, he 
reacts to it in some way, even if his reaction consists only of temporarily recognizing 
a familiar phrase. To heighten the probability of intensive reaction, teacherB often 
pose questions to students to elicit an overt response (integrated stimuli) ifrom the 
student questioned directly. TUs usually elicits covert responses Irom most of the 
other students. If the instructional metI:K)d is to be adapted concurrently to student 
capabiUties, or if the pace is to be adapted to student leaniing rates, stimuU for 
student response miuthe an integral part of the instruction in order to provide the 
besis for branching or pacing. The choice of using integrated stimuli in other in- 
stances is left to the planner. 

Recording Responses* If stimuli for overt student response are integrated 
with the presentation, student responses may be permanently recorded for later use. 
Either the student or the instructor may analyse these records to evaluate mastery 
of concepts or skilly recorded responses may also be used as a springboard for 
classroom discussion. 

In many instances, the responses called for are recorded by their very nature. 
An obvious example is a concrete student product such as a weather map. Unless 
special provisions are made to record them, other responses may be ephemeral; e.g*, 
a student's ability to pronounce foreign words. 

Whether or not student responses are permanently recorded is never an auto- 
matic consequence of prior decisions; the planner must alway$ make this choice* 
Even with adaptive or reqponse-paced programs, which must temporarily register 
student responses in order to ''sense'' whether to go forward and to what point, 
permanent recording for later analysis (by machine or human) requires additional 
equipment 

Type <tf ResfNMise. We Operate responses into two nugor categories: eon* 
otructed and selected. The ntoAtut himself devises a constructed response by 
speaking, writing, drawing, noakinga ooiiCrete Object, checking, adjusting, repairing 
something, or performing some i^ysical act t>LHdi as swinmiing. A selected response 
is one the student chooses firom among two or mor^ previously prepared possibilities. 
To clarify the concept, omsider test and measuremeiit (althou^ the student re* 
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sponses being considered for basic scheduled instruction are those that would be 
made to stimuli int^ral with the instruction, not to an xamination). Examinations 
calling for selected r^^nses are generally known as objective tests because subjec> 
tive judgments do not enter into scoring the answer is either right or wrong. There 
is no room for subjective judgment on the part of the instructor, except as it influ* 
ences his choice of the response to be accepted as correct Test items in these 
examinations are typically muItiple<hoice, true-false, matching, or ordering. 

In many instances it is impooBible to assess student mastery of a particular 
subject by eliciting a selected response. A performing skill such as playing the oboe 
demands that the student be able to perform, not that he merely recognize accepta- 
ble performance or be able to list the aesthetic principles of good performance. But 
it is also poasible that selected responses can be used to assess student mastery of 
other skills, such as computation or reading. Thus, although con'structed responses 
may well be required to assess student mastery of some subjects, they may be 
optional for others. DISTAF provides the planner with the flexibility he needs in 
making this choice. 

The distinction is significant for system design. Because selected responses are 
chosen firom a restricted set, they can be coded for recognition by simple teaching 
machines or by computers* However, only special computers now being developed 
can ''recognize'' constructed responses, and these responses must usually fall within 
a narrow range such as block letters, a small number of spoken words, or a special 
computer language. Even in these instances, the computers are relatively expensive. 
In the current version of DISTAF, we simply assiuie that only selected responses 
can be used for machine recognition or scoring. 

Stimuli calUng for constructed re^nse are ea^y to write, but scoring them 
takes time and skill. Scoring selected responses is simple and can even be done by 
machine. Once the m^iterial is written, many stu^nts may use it without adding 
the heavy burdens of grading papers on the instructor. Item analyses and other 
techniques can be applied to determine test reliability, and so on, but a considerable 
amount of skill is required to r^repare good stimuli caiUng.for selected response. 
Ahnost everyone has had the experience of feelmg that ii particular statement was 
neither true nor false and wondering how to outguess the test writer in choomng the 
proper designation. In addition, some skills, such as proving trig identities, may be 
veiy diflkult to evaluate by calling for sdected response, and some may be impossi- 
ble, such as disassembling and reassembling a pump. 

Feedback to Learner. After thejeamer has had time to respond, he may be 
shown or told whether his answer was acceptable. Ihis information can be provided 
in a variety of ways: bxl instructor or other judge can give it on the spot, the student 
can be shown a model of an acceptable response, or the action of a machine can 
indicate whether or not the response was correct Althouc^ many eduutors believe 
that such feedback enhances learning, experimented results are inconclusive. In any 
event, feedluick to the learner is mandatoiy in any self-directed study. 
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RELATIONSHIP OF ANSWERS TO STRATEGY QUESTIONS 
TO CURRENT TEACHING METHODS 



A primary goal of the DISTAF process is to permit the planner to ''capture" any 
method of instruction of interest to him in terms that will direct system design. This 
section demonstrates the extent to which this goal has been reached to date by 
relating several instructional methods of current interest to sets of values of the 
DISTAF strategy variables. It also shows that DISTAF permits the specification of 
many instructional methods that are not part of most educators! repertoire. 

The Air Force has issued a number of useful publications describing various 
aspects of instruction. Air Force Manual 50-9, Principles and Techniques of Instruc- 
tion, for example, lists the following under teaching methods: demonstration-perfor- 
mance, guided discussion, casensituation (sometimes called role playing), lecture, 
team teaching, the field trip, the laboratory, sociaiized recitation, and progranuned 
instruction. To this list we might add: tutoring, peer tutoring, computer assisted 
instruction (CAD, individualized instruction, and the Socratic method. In general, 
we believe that the requirement for some of these methods should be a consequence 
of hi^er-order design decisions, rather than a.need stated at the outset 

To discuss how these methods are related to sets of values of strata variables, 
we must extract their essential characteristics as they relate to instructional system 
design. First, we note that several of the methods are essentially different from the 
others in that they specify use of some element of the instructional system feuch as 
materials, equipment, facilities, or personnel) rather than a procedure for using such 
elements. These are: team teaching, the assignment, the field trip, the laboratory, 
and posstt)ly CAI, although CAI also has special implications for procedure. Team 
teaching is primarily a method of assigning teachers to classes and usually implies 
modularized scheduling that is, breaking class periods into small units of, say, 15 
minutes each to permit flexibility of scheduUng. This technique has not explicitly 
been included in DISTAF to date, as it levies special requirements on the school for 
date processing, facilities, and staffing. The assignment corresponds to the DISTAF 
cat^ory of unscheduled study and can be fairly ftdly treated by the designer. 
Similarly, the field trip and the laboratory refer to instruction that takes place in 
special facilities, that is, T^P^ TH instruction. 

Next, the re m ai ning methods are grouped according to their requireinente fbr 
overt learner activity and interactions with other learners. 

1. Minimal learner acHvify^-'Lectixie and ledur^forum. We group these 
together because we assuitne tiiat almost any lecture will be followed by or 
interleaved with a "forum" (class discussioa)'of some kind. 

2. Learner interaction with instructional agent but not other learners— Bed' 
tetion,^ the Socratic method, tutoring or peer-tutoring, programmed in* 
struction, and individualized instructioii. These methods all elicit overt 
learner responses dming the.iroBtruction and can be iised in a one*toK)ne 
(teacher-leanier) situation. Recitetion, the Socratic method, and pro* 
grammed instriictidn can also be used in a group (one*to*many) mode. 
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3. Learner interaction with instructional agent and other learners under in- 
structor direction-Gmded discussion. This method elicits overt student 
responses during instruction but requires, a group situation. 

4. Learner interaction with other learners, instructor direction not required-- 
Role playing, dialogue, panel, symposium, draniatization. These are all 
Type n, interactive skills. In most cases, the activity would be preceded by 
a description of what is expected or a model of performance, and prepara- 
tory assignments for unscheduled study, followed by & discussion or smn- 
mary by the instructor. Both the preceding and succeeding activities would 
be classed as separate learning events. 

5. Learner performance, minimal direct in^^n^r^/^-Eemonstration-perfor- 
mance. In technical training this is probably the most common type of 
instruction. As the term implies, it usually involvj^'at least two learning 
events: the presentation cf a model of parformance, and actual student 
performance. The latter may be for development of either individual or 
interactive skills. 

Table 2 traces the choices that a designer would make in using DISTAF if he 
wanted to specify one of the five methods listed above in a form in which its use is 
generally understood. Note that the second colunm identifies the categories of in- 
struction to which the method is usually applied. This designation is an int^ral part 
of specifying the method. A brief discussion of the instructional methods listed in 
Table 2 foUows. 

Lecture 

The lecture method applies to scheduled Type I instruction or to scheduled 
presentation of models pf peiformance in Types n or m instruction for either an 
individual learner or a group of learners. To specify it, the designer first indicates 
that no adaptive method and ho variable pacing wotdd be used. That is, approxi- 
mately the same content would be delivered in the same way and in the same 
amount of time, r^ardless of variations in learner capabilities. He then would 
choose the instructor as the presenter and indicate that stimuli for overt student 
reisponse would not be int^^itai with the presentatioh. This decision automatically 
implies that the instructor i;nU not receive programmed materials and that the 
learner will not receive umnediate feedback r^arding.the correctness of his re- 
sponse (because he has made none). designer can supply background materials 
to the instructor as he sees fit. 

Redtatioh 

Recitation applies to TjHPe I .instructipn and to some student, performance in 
Type n instruction, such as practicing pronunciation; and can be used in either the 
group or individual mode. To specify it, the delErigher chooses to integrate stimuli 
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with the instructor's presentation. Again, the designer can provide the instructor 
with background materials and ez^pect (or direct) the instructor to provide immedi- 
ate feedback to the leameits) regarding the correctness of his (their) responses as 
they are made. These background materials would not be "programmed" in the 
usual sense that a student's progress from item to item would depend on his demon- 
strated mastery of the items, although most instructors would use crude approxima* 
tions of programming during a recitation session, such as repeating items for which 
responses were poor or skipping items that students obviously know. 

Socratic 

The Socratic method applies to Type I instruction. The instructor asks questions 
of the learner or group and frames succeeding questions to the leamer(s) on the basis 
of his (their) replies in an effort to elicit from them what they have learned. The 
designer would therefore choose an adaptive method (which implies variable pac- 
ing), with the instructor as presenter and adapter. Stimuli musthe integrated with 
the presentation because the method is adaptive, and leamer(srmust receive im- 
mediate feedback. The designer would not supply the instructor with programmed 
materials because these would destroy the ad hoc nature of the method. The de- 
signer may choose whether or not to supply the instructor with topic materials. 

Tutor 

Tutoring, used for all types of mstruction, is considered as scheduled instruction 
rather than unscheduled because of the difficulties associated with coordinating the 
joint participation of tutor and learner at odd hours. The tutor is an adapter of 
instruction and, hence, paces the individual learner's progress as the tutor presents 
the items to be mastered. Stimuli must be integrated, of course, and the learner 
receives immediate feedback; The designer has choices about whether to supply the 
instructor with topic materials. like the Socratic method, tutoring implies a laxge 
amount of ad hoc adaptivity, and supplying programmed materials undoubtedly 
would defeat its purpose. 

As the table suggests, the Socratic method when applied in the individual mode 
is similar to tutoring. The primary difference lies in the extent to which the instruc- 
tor presents what is to be lewned With the Socratic method, the learner is expected 
to bring enough background to the session that tiie subject matter can, in e^nce, 
be drawn out of Him by astute questioning. With tutoring, the tutor presents as 
much or as little of the subject as seems warranted by tibie leamei responses. Thus, 
the Socratic method might well call for preparatory assignments; tutoring would 
contain a larger fraction of presentation. 

PeeisTutpr 

The decisions for the peer-tutor are similar to those for the tutor except that a 
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learner's peer is the adapter of instruction; he must be provided with lesson materi- 
als, it being unreasonable to expect a student to acquire these himself. 

Programmed Instruction 

We touch on two types of programmed instruction: linear and branching. Both 
may be used for all types of instruction. To select linear progranmied instruction, 
the designer would use variable pacing. To select branching prc^rammed instruc- 
tion, the designer would use the adaptive method. Either choice automatically re- 
quires that stimuli for overt student response be int^rated with the instruction. 

Linear Programmed Instruction 

Teaching Machines* The migority of teaching machines present response* 
paced programs, and this is the application referred to here. Such teaching machines 
can be used throughout T^pe I instruction and in Types n axid m instruction 
wherever student progress can be checked by eliciting selected responses. Instruc- 
tion may be either scheduled or unscheduled, but if unscheduled, usually the learner 
must work in a carrel or other special facility. Programmed materials must be 
provided for the machine in a communication medium. Background materials are 
needed only in the preliminary stages of the programming and are not supplied to 
each machine. A limited form of immediate feedback to the learner regarding the 
correctness of his responses is supplied automatically by the response of the ma- 
chine, although the learner does not know why his answer was right or wrong. 

Self-Pacing* This method puts the learner himself in the role of the pacer. He 
must be supplied with programmed communication media (progranmied text or a 
teaching machine that is not response-paced) that provides immediate feedback on 
the correctness or acceptability of his resjponses so that he knows how to pace 
himself. As before, background materials are not needed for each leamer. Responses 
may be either selected or constructed. 

Branching Programmed Instruction 

CAL As with the term teaching machines, the term CAI has many interpreta- 
tions and implies the use of various instructional methods. Computers can use 
adaptive programs^^ to branch students along diflfereht paths, contingent on their 
responses to stimuli As with linear programmed instruction, only selected re- 
sponses can be used in this way. Ah adaptive program also paces the instruction and 
uses a communication medium to present ttie iiistruction. Other choices and conse- 
quences are the same as for the t>eacHffig machine using a resiponse-paced program. 

Individualized InstructioiL This term can also ref^ to any of several combi- 

Usec^oomputenforlineArprograJimiediiitt^^ 
lets ezpeium teadiing maehiiies and other ra^onaeiMdng devices do as well 
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nations of values of DISTAF strategy variables. Many individualized systems are, 
in fact, combinations of programmed instruction (either linear or branching) and 
various degrees of adapavity of course content, the most common type being to adapt 
content to student prior learning as determined by a diagnostic pretest Some in- 
dividualized instruction also includes individually prescribed learning objectives 
that are not part of the basic course; usually these represent only a small fraction 
of the student's total course of study; DISTAFs provisions for enrichment and 
remedial topics could easily be used for this purpose. DISTAF also offere many 
possibiUties for taking account of student learning capability or style in planning 
and carrying out instructions. 

The individualized instruction shown on the table puts the learner in the role 
of adapter (and hence pacer) of instruction. Other choices and consequences are the 
same as for self-pacing. 

Guided Discussion 

Guided discussion requires an instructor to direct a group of students; hence, it 
is scheduled instruction. It can apply to subjects taught in all categories of instruc- 
tion and can be designated by answering "yes" to questions on discussions scheduled 
during class hours. Discussions intended primarily to develop such social skills as 
communication, leadership, and listening (rather than reviewing and exploring 
previous work) are scheduled Type H insfaruction, interactive skills. 

A guided discussion requires the instructor to adapt and pace the instruction for 
a group of students. Because the students themselves are expected to contribute to 
the discussion, tiiey are presenters, along with the instaructor. StimuU for student 
response must be integrated with the instruction, of course, but programmed materi- 
als would destroy the spontaneity of the discussion. Background materials might be 
provided, and learners might be given immediate feedback, at the designer's and 
instructor's discretion. 



biteractive ActivitiM 

Dramatization and similar interactive activities are scheduled Type n instruc- 
tions involving stodent performance. (These activities have been grouped because 
their requiremwitB for resources are about the same.) The students assume more 
responsibility for adapting -tiie direction and pace of the. activity than in guided 
discussion, stimulate ewh other, and usiially tell each other when responses are 
partiqilarly apt or inept At thie dw^ert optioii, materitds sudi as rules of play, 
directions, references for prepsrotion for pMel d^^ backup 
papers naay or may not be supplied UfwaUy active role playing are 

preceded by a preparatory leuning event uid followed by some kind of discussion 
or critique. 
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Demoiistratioii-Peifoniiance 

Demon8tration-performance> as described in Air Force Manual 50-9» is a struc- 
tured activity used in Types n and m instruction under doee supervision by an 
instructor* The instructor demonstrates the performance the students will subse- 
quently practice. He then provides initial directions for their performance^ supers 
vises it closely^ giving directions and commenting on the work as it proceeds, and 
follows the session with a critique. At the other end of the spectrum, however, it 
would be possible for an instructor simply to give initial instructions and leave. 
Students could check their progress from models or by talking to each other. These 
options are indicated in the table. 



IV. EFFECTS OF mSTRUCnONAL STRATEGIES ON 

SYSTEM DESIGN 



The final design process int^tes the Curriculum Analysis and the DISTAF 
output to describe an instructional system in terms of student flows and time- 
dependent requirements for resources. This section shows how responses to the 
DISTAP decision pointe, interacting with data ftx)m the Curriculum Analysis, prth 
vide guidelines for this process. First, the determinants of student flow are treated, 
as many resource requirements depend dire.^y on the number of students to be 
taught Next, variable values that directly afffect requirements for instructors and 
other teaching staff* are described. Then values that directly affect requirements for 
teaching materials, instructional aids, and equipment are similarly discussed. The 
section ends with a table summarizing the effects pf the strategy variables on system 
design. 



STUDENT FLOW 

The flow of students through a course generates requirements for resources of 
all sorts— instructors, facilities, materials, equipment, and, if students are supported 
by the teaching institution, student pay--as well as determining the rate at which 
students graduate. Many DISTAF variables were chosen to permit precise descrip- 
tion of the way student flow is related to resource requirements. Student flow is, in 
essence, determined by tibree main items: the amount of material each student must 
learn, the regular claas time to set aside for basic scheduled instruction, and student 
learning rate. 



Dedsioiis AjBTecting the Amount of Bfaterial Each Student 
Must Learn 

The Curriculum Analysis provides the basic description of the amount of 
material each student must learn. This information may be modified in li£^t of 
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decisions made in stating general policy so that course content can be adapted to 
student background or learning capability or both. At this point, DISTAF asks the 
planner to indicate what means he will use to place students in the proper cat^^o- 
lies, by typing 1, 2, or 3. If he types 1, in the model of student flow, students are 
tagged as belonging to one or another cat^ory on the basis of general information 
on their background available when they enter the course; if he types 2, assignments 
are made after an initial tryout period in the course; if he types 3, assignments are 
made on the basis of a diagnostic pretest. In effect, iie assigns the value 1, 2, or 3 
to the strategy variable A(76)." Prom this point on, students receive the modified 
course appropriate to the category assigned them and are placed in the appropriate 
track or group if these are formed. 

Decisions Affecting the Regular Class Time Set Aside for Basic 
Scheduled Instruction 

Students may be expected to do a significant amount of learning outside of 
r^;ular class hours, that is, during unscheduled study. As more of the basic materiial 
is designated for unscheduled study, student flow increases, presuming that students 
can master the materials on their own. Learning events for unscheduled study are 
so designated in the Curriculum Aiudysis. 

Unscheduled study can generate instructional activities during regular class 
hours, however, such as checking and discussing the assignment If r^^ular class 
time is devoted to such activities, _(73)" indicates the number of minutes required, 
on the average. This time is then added to scheduled instruction following un- 
scheduled study. 

Basic scheduled instruction can generate similar requirements for additional 
time during regular class hours. If an instructor or student leader does not present 
the instruction, it is possible that the planner will want to set aside some class time 
for students to discuss the instruction with each other or with the instructor [A(18) 
= 1]. In that event, A(12) gives the percentage oif time in basic instruction to set aside 
for discussion sessions and A(77) determines the frequenpy with which these sessions 
will occur. 

If the students discuss material presented by a communication medium with a 
monitor or instructor during the presentation [A(17)==2L it adds 5 to 10 minutes to 
the presentation time, with a resultant effect on student flow. 

Similarly, if ths instruction requires students to make overt responses, the 
planner may decide to use these responses as a springboard for class discussion by 
setting aside class time for scoring the responses [A(58)=:l]. 

Formal examinations r^Kulate student flow and also take time during regular 
class houra. The specification of the frequency of examinations at all levels from 

Stratagy variables utsd in this report are defined in Appendix D. 
" Tlie notation **^00r indicates that there is mora 
the value is determined for more than one category (^Instniction. lU^ 
and simple and oompkz n instniction. 
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quizzes to finals is denoted by variables e(14) or e(24)-" Variables e(194) or e(20A) 
denote the average length of each type of examination* 

If students are academically mature, reviews before examinations are fre- 
quently assigned for unscheduled study [e(124)=0 or e(144)=0]. Scheduling reviews 
[e(124)=: 1 or e(lii)= 1] decreases the rate of student flow, but may also decrease the 
failure rate. The number of minutes devoted in class to each type of review is 
designated by e(164) or e(184). 

Finally, the method ofpreeenting the instruction also affects the amount of time 
spent during r^^ular dass hours* Instruction presented by a live instructor or tutor 
[_(6)= 1 or 3, _(19)==1 or 3, _(60)=1 or 3, _(61)=0, A(97)=l] may ramble or miss 
important points, thereby requiring retracing of part of the material; or simply be 
poorly orgiainized and conftising to the student It is generally conceded that using 
conmiunication media for instruction can decrease learning time by forcing the 
attention and resources on planning and production that are needed for efficient 
conmiunication. 

Decisions Affecting Student Learning Bate 

The Curriculum Analysis provides the basis for deriving the student learning 
rate. In it, the planner estimates the time required for each learning event in 
conventional instruction. This time usually reflects the learning rate of students 
with somewhat below average ability. In many schools, the subject matter is pre- 
sented on a fixed schedule; i.e., eveiy student is supposed to be studying approxi- 
mately the same content at the same time [A(53)== 11 Students may drop out of a 
course at specified points, however the percentages of students leaving at each point 
will vary. Or students may recycle through a part of the course if they fail the 
examination covering that part or have had excessive absences; again, the repyding 
rate will vary for different parts of the course. 

To accommodate to wide ranges in student learning capabilities, many schools 
have introduced methods that permit students to proceed through course content 
along diffferent paths [A(l)=2 or A(l)=l and ^64)r^Qi (adaptive instruction) or at 
diffferent rates (A(2)= 1 or A(2)=2 and —{14)^0] (variable pacing). Adaptive instruc- 
tion always implies some type of variable pacing, depending oh the type of adaptivity 
used. Generally, in sudi i^ystems the average student finidies the course in less time 
than would have been allotted for fixed-schedule instruction, partly bec^xuse fixed- 
schedule instruction tends to a4just to the slower student's learning rate and partly 
because the opportunity to finish the work sooner motivates most students to learn 
facter. To add or ehhanoe motivation for rapid progress throuig^ the course, a num- 
ber of educators have advocated the use of incentives— material rewards for com- 
pleting topics or units of subject matter [e(26,l)=l]. Bewardihg^students giving 
them time during dass hours when they are free to use recreational facilities and 

i^Mthn* it k cakndsr tioie or cborss (Dontent 
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the like 18 also used as an incentive [A(28)=:l]. To some extra 
rate of student progress through «the course. 

Adaptive instruction or variable pacing may be used within a ''fixed** schedule 
by requiring each student to be at the same point in the course at designated times, 
such as just before nuyor examinations or at the beginning of each day» but allowing 
students to proceed at theur own pace within these limits. Alternatively, the 
schedule may be completely free, with only an upper limit set on the time an 
individual student may spend in the course. 

Sfudent learning rates are also affected ifstudents are put into tracks or groups 
[_(54)i^0] on the basis of their capability. This technique probably tends to lower 
the average rate of progress to some extent, although students in above-average 
groups or tracks will stall progress faster than those in below-average groups or 
tracks. 

A suailar tactic may be used when the only adaptivity is to adlfust the rate of 
instruction, if students are grouped by learning rate [-480)^0]. This is a particu- 
larly useful device if the Curriculum Analysis designates learning events that re- 
quire students to interact wJ*^h one another, as in work teams, sports, or role playing. 
Such requirements are e^y met in a fixed-pace course; but if the course wei^ 
individually paced, a student might have to wait until enough other students have 
caught up with him to form the group of the required size, designfited in the Cur- 
riculum Analysis. Variable pacing of groups of students that have nearly the same 
learning rates allows the planner to meet the need for interactive groups and still 
realize most of the benefits of variable pacing. 



PERSONNEL 

Because teacher salaries are a nuyor (or the nuyor) cost of mstruction in most 
schools, DISTAF emphasizes variables that affect peroonnel requirements. These 
are directly affected by the number of tasks assigned, their firequenpy and length, 
and the ratio ofstudents to emploj^ personnel for each task. In general, student/ 
personnel ratios dependupon specific requirements (as for safety monitoring)stated 
in the Curriculum Analysis or upon the facilities available. Some of the DISTAF 
variables affect student/personnel ratios indirectly. These are mentioned during the 
following discussion. 

Table 3 displays tasks that may be assigned to instructora, student instructors, 
or clerks. Generally, the j&equency and length of these tasks may be determined 
from Curriculum Analysis data; instances in which they are not are noted 

If an instructor presents basic instruction during class hours, as in the first 
three tasks listed, the Curriculum Analysis gives tfa^ fr^uenqr dii^y. The time 
required for presentation (task 3) is also given directly; for tasks 1 and 2, student 
learning rate affects time, which must be derived by jrim ^i^ting student flow. Stu- 
dent/instructor ratios are indirectly affected by any tracking or grouping used 
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Table 3 

VALUES OF VARIABLES REUTED TO PERSONNEL REQUIREMENTS 







Determinants of 




Tasks 


Frequency 


Length 


1. 


Adapt" basic instruction: 
_(63)-l and _(6)-l 


C.A.* 


C.A. 


2. 


Pace basic instruction: 
_(14)-3 (_(63)-0] 


C.A. 


C.A. 


3. 


Present basic instruction: 
_(6)-l I_(14)-0 and_(63)-0J 


C.A. 


C.A. 


4. 


Discuss media presentations during 

presentation: 

A(17)-2 


C.A. 


C.A. 


5. 


Monitor DCd i;i orPAPn t At i nn& * 

_(78)-l or 2 


C.A. 


C.A. 


6. 


Present Type I instruction requiring 
special facilities or equipment: 
_(61)-0 


C.A. 


C.A. 


7. 


Present models of student performance: 
_(50)-l 


C.A. 


C.A. 


8. 


Present follov*me demonstrations; 
_(19)-1 


C.A. 


C.A. 


9a. 


Discuss media presentations after presentation 

and during class hours: 

A(18)-l 


C.A. & 
A(77) 


A(19) 


9b. 


Discuss media presentations after presentation 
and outside of class hours during work day: 
A(18)>2 


C.A. 


A(19) 


10. 


Check homework in class: 
(73)^0 


C.A. 


_(73) 


11. 


Present reviews and examinations: 
_(55)-0 and „(6)-l or 3 


e(l,i)' or 
e(2,i)b 
e(12,i)^or 
e(14,i)b 


e(19,i) or 
e(20,i)b 
e(16,i) or 
e(18,i) 


12. 


Proctor examinations: 

e(26,i)-l or 2 or e(27»i)-l or 2^ 


e(l,i) or 
e(2,i)b 


e(19,i) or 
e(20,i)^ 


13. 


Present remedial instruction: 
A(97)-l; or.A(64)-l, A(97)-0 and 
_(6)-l 


C.A. 


A(96) 


14. 


Score exams outside of class but 

during woi'k day: 

A(51)-l 


e(l.i) or 
e(2.i)b 


i^coring 
formula 


ISa. 


Score studene worR in class: 
A(58)-l 


C.A. 


A(19) 


ISb. 


Score student. work outside of class 
but during work day: 
A(59)-l or A(10)-2 


C.A. 


scoring 
fotmula 



^Determined directly from Curriculum Analysis. 
Choice of variable depends on basis of examination schedule. 
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[_(64)=0 or _(80)=0] and are also affected by requirements for interaction with 
the students levied by adaptive instruction or variable pacing* 

The frequenqr and time required for discussing media pr^utations during the 
presentation (task 4) or» if this is not to be done, simply monitoring media presenta* 
tions (task 5) can also be derived from the Curriculum Analysis. Task 4 adds 5 to 
10 minutes to the presentation and requires a relatively low student/staff ratio (say 
10/1) unless the instructor can handle several groups at once through a communica- 
tion medium. This possibility is permitted if the instructor or monitor is not requiml 
to be accessible continuously during the presentation [A(22j=0]< 

For tasks 6 to 8, the instructor demonstrates a concept in a special facility or 
by using special equipment or demonstrates a skill that students will subsequently 
master. Again, the Curriculum Analysis gives the frequency and time required for 
these tasks and also indicates the maximum number of students who may view the 
demonstration at one time. 

Task 9 sets aside a special time for discussing media presentations after the 
presentation, either during class hours [A(18)=l] or outside of class hours but 
during the instructor's working day [A(18)=:2], Hie frequency of theM discussions 
is determined by the frequency and length of media presentations; the length of 
discussion sessions, indicated by A(12); and the guidelines for determining when 
enough discussion time has accumulated, indicated by A(77). 

If assignments for unscheduled study (homework, task 10) are checked in class 
[_(85)=1], the time required for this [—(73)] is added to Urn instructor's duties 
following each assignment listed in the Curriculum Analysis. 

The instructor may present reviews and examinations (task 11) if the printed 
page is not the only medium used [— (55)=0] and an instnictor or student leader 
[— (6)=1 or 3] presented the basic instruction on which the students are to be 
evaluated. There will be an exception to this rule for examinations (only), however, 
if the final system design includes media systems that would be appropriate for the 
instruction for which — (6)=1 or 3. In that event, the media system replaces the 
instructor for presenting the examination* The fi:equency and length of task 11 
depends on the examination reqiiirements, the related review requirements, and the 
^'alues of .^6) for learning events on which students are evaluated 

The frequency and length of task 12 is derived directly from the examination 
schedule. 

An instructor presents remedial instruction (task 13) during his working day if 
A(97)=l or if A(64)=:i, A(97)=0, and_(6)=l. The Cuiticulum Analysis designatec 
learning events that are above average in diflkulty, and remedial sessions of the 
length indicated by A(96) will be scheduled into the instructor's woikload 

Tadcs 14 and 15 allocate instructor time for scoring^^ examinatior i (task 14) 
and scoring class woik (task 16). Research on test and meaisurement suggests that 
formulas can be used as a roufl^ guide to tfie time requi^ 
tive tests* These formulas are applied to tasks 14 and 15b. 'hie frequency of task 

" E. F. ZindquMt (ad)* Edaeatiomd Meawi'imint, Americu orEdueatkm, Geoife B«ita 

Publiahiiig Compsny, UtmAat, WkoocMiiii, 1S6L 
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14 depends on the examination schedule, of course. Task 15 is generated by student 
work recorded during basic instruction for which answers are not supplied to the 
students t_(8)= 1 and _(29)=0J. If student work is scored in class, the time required 
will be similar to that required for discussion [A(12)]. 

Two variables can apply either to an instructor or to someone of lower rank 
such as a student instructor or a teacher's aide, lliese are the monitor for media 
pre8entatio.is (task 5) and the proctor for examinations (task 12). Two other varia- 
bles, excluded from the table because they are not task-ielated, have similar implica- 
tions for 'personnel. They are the variables that allow the planner to specify special 
instructors for students in a slow track te(21,l)=ll or a fast track (e(21,2)=ll. 



MEDIA MATERIALS AND PROGRAMS, AND INSTRUCTIONAL AIDS 

Requirements for media materials and programs, and instructional aids depend 
on factors similar to those that determine personnel requirements, viz., the tasks to 
be done, their irequenqr and length, and the number of students who may view a 
single display (this is always 1 if the medium is the printed page). Some additional 
considerations relating to the cost of the initial production are also treated. 

Table 4 parallels Table 3, showing the tasks, the determinants of frequency and 
length, and factors bearing on the initial production cost As before, the number of 
students who may view a single display is suggested only roughly by DISTAF ou^t 
Other factors must be considered before these numbers may be determined more 
exactly. 

Communication media play a direct role in adapting instruction to student 
capability (task 1) if the adapter is either the learner himself or an ^ptive pro- 
gram. The Curriculum Analysis determines the fiequenpy and length of learning 
events that use adaptive methods. Because the method is adaptive, branching is 
reqiiired, which means that the amount of material or program that must be pro- 
duced will be at least doubled. The requirement for branching programming means 
that stimuli for overt student response must be integrated with the pnsentation; 
this, in itself, lengthens the production, process and further increases producticm 
costs. Finally, if correct answers must be supplied along with tho presentation, as 
they must if the learner is the adapter, additional presentation of answers or 
remedial instruction is required. This can be considerable in l^P^ D complex in- 
struction or in IH instruction, in which a model of an acceptable pnduct may 
have to be depicted. 

The numberofstudentswhocwviewandinteractmthagivenmediapies^ 
tion depends in part^on whether tracking or groupjing is used. Le., if _(64)^0 or 4. 
If ^64)=4, instruction is completely individualised, and only one student my use 
anysetofmateriaLicrpi'Qgranuatonetiii^ 

timfrflharing of materials. The number of distinct sets of materials reqtdred will also 
be determined in part "oy^64). Bfedia ^jFstem dcngn may be different for each tmik 
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Table 4 

VALUES OF VARIABLES RELATED TO MEDIA MATERIALS REQUIREMENTS 



Adapt basic Instruction: 
_(63)-2 or 3 



2. Pace basic Instruction: 
_(l«)-2 or 4, I_(63)-0) 

3. Present basic Instruction: 
_(6)^1 or 3, I__(14)-0 snd 
_(63)-0) 

4. Present Type I Instruction requiring 
special facilities or equlpKnt: 
_(61)-1 

5. Supply background aaterials for 
student leader or Instructor: 
_(63)-l or 4, __(21)^ 
_(i4)-l or 3, _(21)W 
_(6)-l or 3, _(21)-1 

(50)«1 or 3, (52)-l 
Ta(97)-1 and 721)^0) or 
lA(97)-0 and 36) -(I or 3) 
and _(21)^) 
__(19)-1 or 3, H(62)*l 

6. Present aodels of student perforoance: 
_(50).2 or 5 

7. Present folloir-M deaoostratlons: 
_(19)»2 or 5 

8. Present asslgnaenu for unscheduled 
study: 

_(45)^ 

9* Present revlcvs: 
_(55)-l or _(55)-0 
and _(6)^1, or 3 

10. Present exaast 

_(55)-l or _(55)^) 
and _(6)^ or 3 

11. Clve diagnostic pretest: 

A(76).3. 

12. Present reMdlal Instruction: 
A(64)-l, A(97)»0, and'__(6)rt or 3 

vor A(64)-2. / _ , 



Deter«ln«nts of 



Frequency 



C.A.* 



C.A. 
C.A. 

C.A. 



C.A. 
C.A. 
C.A. 



e(12.1) or 
e(14.l) 



a(l.l) or 



Beginning 
of course 

C.A. 
C.A« 



Length 



C.A. 



C.A. 
C.A. 



C.A. 
C.A. 
C.A. 



e(16.1) or 
«(18.1) 



e(19.1) or 
«(20.i) . 



A(96) 
C.A. 



Variables Affecting Cost of Production 



Variable 



<29)-l 
j54)-x 

(7)-i 
<29)-l 



_<63)W 
_<14)W 
_(29)-l 

— <29)-l 

_(21)-2 
_(16).l 



<21)-2 
'(16)-1 



(39)-l 
_(46)-l 

e(lS.l)«l or 
e(17,l).l 

(3.1) or 

(4.1) 

_(23) 

e(3.n -sr 
(6.0 



Meaning 



trenching required. 

Stlaull for overt student response 

Integrated with prograa. 

Ansvers provided vlth presentetlon 
nuaber of distinct sets of prograas 
required deteralned by value of x. 

As above. 
As above. 



Adaptive Instruction: branching. 
Variable pacing: Integrated stlaull. 
Ansvers provided with presentetlon. 

Answers provJded wlth-presentatlon. 

Stratified mterlals required* 
Prograaned guide required. 



As above. 
As above. 



Stlaull Integrated with presentation. 
Answers provided with presentation. 

Special aaterials will be prepared 

for review sessions. 

The learning evenu to be. reviewed. 

Aaouat of "objective" test to be 
prepared. 

The learning events to be tested. 



See task I. 



^teialoed directly froa Curriculua itaalysis* 



or group, and differont amounts and. types of materials may be required for each, 
depending on the subsequeiit.strat^ and the Curriculum Analysis. 

Similarly, comn?unicatiori media play a direct role in matching the pace of 
instruction to student learning rate (task 2) if the pacer is either the learner himself 
or a response-paced program. Production costs increase over those of conventional 
production because of the additional dme required to prepare linearly programmed 
materials. As before, the requirement for providing correct answers can add consid- 
erably to production reqmrements in Type U complex instruction. Again, the num- 
ber of students who can use a given program at one time depends in part on whether 
students are grouped by learmng rate [—{80)^0] or whether rates are determm^'d 
individually. 

The least expensive production applies to task 3, which requires only presenta- 
tion, with no int^rated stunuli or correct answers. The planner may, however, 
include these iten^ ifihe j^ishes, even though he is not using branching or linear 
programming. Alsorthe Curriculum Analysis may indicate that the presentation 
requires the use of special equipment, or must take place in a special fecility, or may 
involve more than one person, as in demonstrating a team sport. Each of these adds 
to the cost of initial production.. 

A special instance of the above appears in task 4, which is assigned to a com- 
municaltion medium if special &cilities or equipment are needed to make a presenta- 
tion that an instructor would otherwise make in Type I instruction. Since this case 
can arise in either adaptive instruction, variable pacing, or iSxed-pace instruction, 
considerations of the production costs are the same as those appropriate to tasks 1, 
2, or 3. 

Task 5 is a catchall for instances in which an instructor or student leader is the 
adapter [_(63)=1 or4], pacer U(14)=l or3], presenter [_(6)= lor 3], demonstrator 
[_(50)=1 or 31 or presenter of reipedial instruction [A(97)=l and _(21)=0, etc.] In 
each case, if the variable following the comma in the list describing task 5 has the 
value shown, special background materials, including instructional aids, must be 
supplied to the instructor or student leader. As before, the production costs are 
affected by a decision to supply the presenter with correct answers. With adaptive 
instruction [_(63)=1 or 4], the background materials may be modularized and 
prepared omthree or four levels of difficulty [_(21)=2] (stratified materials), further 
increasing the skill and time required (and hence the cost) to produce them. Simi- 
larly, with variable pacing M14)=l or 3], a programmed guide may be required 
[_(16)=1]. These choices are also applied to the back^uhd materials prepaid for 
remedial instruction, as appropriate. 

Conmiunication media present models of student performance, follow-me 
demonstrations, and assignments for unscheduled study if _(50)=2 or 5, -:^(J9)= 
2 of 5^ or _(46)^0 (tasks 6, 7, and 8)./Tlie pnnted pag reviews and 

laminations if _(55)=1. If _(65)=^0^these leaniing exmtB are presented by what- 
ever means was used in the original instruction. If tliis was a communication 
medium [_(6)t^1 of 3], it presents the review and examination. The frequencgr and 
length of these presentations is specified by the yariables.shown in Table 4 for 
tasks 9 and 10. 



38 



The Curriculum Analysis identifies learning events on which student mastery 
will be evaluated in formal examinations. By specifying whether an examination 
will cover only the material presented since the last examination of the same type, 
or wliether it will be more comprehensive, e(3,i) or e(4,i) identifies the learning 
events to consider as candidates for evaluation and specifies the requirements for 
media to assure that each candidate event can be evaluated, if so desired. 

Communication media are used to present remedial instruction in scheduled 
sessions if A(64)=l, A(S7)=0, and _(6):^1 or 3 (task 12). Of course, media are 
required if remedial assignments are made for unscheduled study [A(64)=2]. The 
Curriculum Analysis determines the frequency of remedial sessions in which par- 
ticularly difficult learning events are noted. A(96) estimates the length of scheduled 
remedial sessions; the length of unscheduled remedial assignments is determined 
from the Curriculum. Analysis in which such assignments must be described. 



EQUIPMENT 

The equipment discussed below is largely that required for the appropriate 
communication mediiun needed for the instruction. Wherever a variable value di- 
rectly affects requirements for media materials and programs, it usually affects 
equipment requirements. If the materials are explicitly designated ^'background 
materials and instructional aids" [—(21), _(52), and A(99)], the instructor or student 
leader uses communication media for only preparing and supporting l^^presenta- 
tion, and little equipment is required. 

A few other types of equipment designed specifically for instructional use are 
also treated. Training devices or actual hardware that students would operate or 
work with are excluded, since they cannot trade off* with instructors. 

There is a special implication for equipment if the learner adapts instruction 
for himself [_(6d)=3]. He must have complete freedom in using the media; that is, 
he must be able to skip forward or backward, go fast or slow, stop or start as he 
wishes. We term this capability internal random access. It must be provided when- 
ever the learner will be using communication media adaptively: scheduled instruc- 
tion [_(6)=2 or 5], follow-me demonstration [_(i9)=2 or 5], presentation of models 
of performance [_(50)=2 or 5], presentations in Type I instruction requiring special 
facilities or equipment [^(61)=1], imscheduled study [_(45)=2 or 5], or remedial 
instruction [A(97)=0]. The program has to be coded so that the learner knows to 
what point he wishes to skip or return. The printed page automatically provides 
internal random access. Since mcmy subjects cannot be effectively transmitted via 
the pnnted page, however (such as the sound of a missing engine), the requirement 
for internal random access of otherwise fixed-nimat^^ may be significant in 

many cour8eB.,If interiial random a6[^ is 1; 

A similar requirement applies if the leameris his own^p al- 
though the only additional equipment needed for this is a stop^d-start control for 
the program. 



39 



Three kinds of programs with equipment that exercise various degrees of con- 
trol may be specified: adaptive, response-paced, and fixed-duration. Each has special 
equipment requirements. Equipment for the first two must be able to stop the 
program to wait for student response, sense the response, and react to the response 
in a preceded way. Usually a computer is required to present an adaptive program, 
but many simple teaching machines may be response-paced. The fixed-duration 
program sijnply requires something on which it can be run--a movie projector, tape 
player, or television set, for example. 

A special difficulty arises if any of these programs is used for unscheduled study. 
Most teaching machines and all computers are too bulky or too expensive for stu- 
dents to carry them to the dormitory or the library for unscheduled study. This 
means thatalearning center or other faciUty for the studente must be equipped wit^ 
carrels and the needed hardware, or remote access must be provided via some 
electronic distribution system. Portable cassette players for audiotape are becoming 
less expensive and more durable. In the future they may be checked out for un- 
scheduled study or required of each student as textbooks are. 

If student responses are recorded [_(8)= 1 or _(47)= 1], special equipment may 
be needed where recording is not inherent in the kind of response being made. 
Student perfomance of requiring body movements, such as loading an air- 
craft, or interactmg with others, such as following commands, can be recorded on 
videotape for later analysis and critique. Audiotape recordhig of the student's 
spoken language has been found widely usefiil in studying foreign languages. 

Scoring student work by machine [A(10)=l or A(57)=l] can save instructor 
time, perform item analysis and other checks on the reliability of printed tests, 
supply statistical information on indiividual studente and groups of studente, and 
assist the instructor in diagnosing student progress. Small computers are sufficient 
for these purposes. There are also relatively inexpensive mark-sense j^ystems that 
can at least add up right and wrong answers. 

If A(22)=0br A(5iB)==0,aninrtTUcitorcan 
of studente via a communicatioh medium frbm a remote point Studente can discuss 
their problems among themselvies and, upon coining to a difficult item, can query 
the instructor at a predesignated tMe. Closed-circuit TV or two-way radio have been 
used in this application. 



SUmfARY 

The fon^oing discussion is siimnu^^ Table 5, which notes the i^ystem 
elemente that each istiat^ variable a^^ dii^riix^-^Wha aflfecte student flow, 
of course, affecte aU other :^«»m^ Irecfe ire not shdwn, Similarly, 

using.a student leader iw^a praa^ 

dassiwm duties. Since tl^ do^^^^ generate a pqritive r^iiiieme^^ for an instruc- 
tor, there is hoVcbeckih^^ V " 
^ Variables are listed in alph^ii^ and numeriral order. ^ 

40 



! \ 




Table 5 



EFFECTS OF STRATEGY VARIABLES ON SYSTEM DESIGN 









Ufects 


Ceneretes Positive Requirements 
for 'Resources 


Variable and Valua 


Mtaaint 


•tudent 
Flow 


Personnel 


Hateriels, 
Prograas 


Equipment 


A(l)*2 or 
A(l)-1 and 


_(54)^ 


Adapt ccachins MChod Co tcudanc laamint 
capability* 


X 








A(2)-l or 
A(2)«2 and 


_(13)-1 


Use variable pacing. 


X 












Prtscnccr is: Inttructor. 




X 






-2 
-3 
-4 
-S 
-7 




Any approprtacc coa^unication atdiua. 
Studenc leader. 
Adapcive prograa. 
Fixed-duracion progran. 
Kctponttt* paced prograa. 


X 

X 
X 
X 




X 
X 
X 
X 
X 


X 

X 
X 
X 






Scinuli for overt response integrated with 
scheduled baaic instruction. 






X 








Keaponses permanently recorded. 








X 


A(10)-l 
«2 




Classroon work with selected response 
Mchine scored. 

The instructor will score classro<Mi work 
with selected response during his work day* 




X 






_(14)-1 




Pacer is I Student leader 










-2 
•3 
-4 




Learner^ 

Instructor. 

Response-paced pr6gran 




X 


X 
X 


X 
X 


^(16)- 1 




PrograMMd guide supplied. 






X 




A(17)-2 




The student can dlacuaa Mtarial praaeatad 

by a coenunication mediuM with a Monitor or 
instructor during the presentation* 


X 


X 






A(18)-l 
-2 




The atudent can dlacuaa aatarial praaentad 
by a coawunication Mcdiun in a later teaslon 
during regular class houra. 

All F ft 1 ddl 1 KAit 


X 


X 






_(19)-1 

ml 

-3 
■5 




An instructor will present follow-M 
denonst rat ions. 

Any appropriate coaaunication aediiui*.* 

A student leader*.* 

A f ixed-duration progran.** 


X 


) 

X 
X 
X 


X 
X 


—(21)^0 




Background Mtariala and inatructional aids 
will be Supplied. 






X 


X 


A(22)-0 




During instruction by a coMunication ■cdiiw, 
an inatructor or Monitor will be inteToit* 
tently accessible to atudenta via' a coanunl- 
cation nediua. 








X 


«-(23) 




Dcnotea the anount of formal exaainatton 
that will be by objective tests. 






X 




A(28)-l 




Students will receive free tiac as an 
incentive to reach course objectives. 


X 








_(29)-l 




The student will be provided with a aodel 
raaponse after Ke haa had tiae tc reapond. 






X 




_(39)-l 




Stiauli for overt responae integrated with 
assignments for unscheduled study. 






X 




_(45)-2 

»4 
-5 
-7 




Aaaignaanta for unachtduled atudy will be pre* 
aentad by any appropriate tOMunication aed. 
•**an adaptive prograa. 
•••a fixed-duration prograa* 
.•.a reaponse -paced prograa. 






X 

X 
X 
X 


X 

X 
X 
X 


_(46)-l 




Hodel reaponses will be provided in 
unscheduled study. 






X 




_(47)-l 




Lesrner responses in unsche<luled study.will 
be recorded* 








X 


_(48)-l 




Liearnere will be able, to go back over the 
aatetiel for unacheduled study* 








X 


_(50)»1 

-2 
-3 
«S 




Mode Is of student performance will be 

deaonstrated by an instructor* 

.;*any appropriata-coMNinicarioo aediua* 

.•.a atudent J,eader. 

*l.a f ixed-dulration' prograa. 


' X 

x 


X 


X 
X 
X 


X 
X 


A(51)-l 




The instructor will have part of his work 
day for scoring' exaainations. . ' ^ 




X 
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- Table 5— continued 







Affects 


Cenerstes 


Positive RequircMents 
^or Resources 


V«rUblc «nd Value 


Ht«nlnt 


Student 
Flow 


Personnel 


Progr* 


6 


} 

Equ ipMent 




A guldi and Inttmctlonal aids for danon* 
stratlng Models of parformancc will be 
provided. 






X 






-4 


Student* will be divided into groups on 
the basis of thtir lesming capability* 
Students will be trested on an individual 
basis. 


X 
X 


X 
X 


X 
X 




X 
X 


_<55)-l 
-0 


Rcvicvc and exaainations will be presented 

by printed Mterials, 

•••by the sane atsns as the original 

instruction^ 




X 


X 
X 






A(S6)-0 


Th* instructor does not have to be physi- 
cally present for discussion sessions • 










X 


A(57).l 


Objective tests will be Machine scored^ 










X 


A(S6)»1 


Students will score daily work in class^ 


X 


X 








A(59)-l 


The instructor will have part of his work 
day for scoring classroon work with con* 
structed response^ 




X 








— <61)-1 
-0 


A cotBMunication Mediun will be used in 
Type I instruction to Make presentations 
requiring special facilities or equipMent^ 
A conaunication aediua will not 'be used^^^ 


X 










-2 
•4 


An instructor will adapt tta'ching Method 
to student learning capability • 
An adaptive progrsM^^^ 

A student 'leader* •• 




X 


X 
X 




'x 

X 


(73)^ 


Jhm average nuMber of Minutes spent in 
class checking or discussing an assignr 
■ent for unscheduled study^ 


X 


X 








A(76).l 

•2 

•3 


Students will be designated to take Modi- 
fied course content by prior infotMatlon 
on their backgrounds 
• ••t>y evaluation of their work efter en 
initial period^ 
•••by a diagnostic pretest^ 


X 

X 
X 










A<77)^ 


Frovides rules for scheduling discusi>lon 
sessions^ 


X 










_(7«)«1 or 2 


An instructor or clerk Must Monitor in- 
struction presented by a coMMunication 
■ediuM^ 




X 










Students in a variably paced course will 
be grouped by leaminc ratei 


X 


X 


X 




X 


A(97).l 
-0 


Scheduled reMedial seMlont \^ill be con- 
ducted by an instructor^ 
• ••In the ssMe Manner as basic initruc- 
tion* 


X 


X 
X 


X 




X 


e(l»l)-l.or 


Denotes schedule of forMSl exsMinations^ 


X 










c(12.1)*l or 
e(U,l).l 


Denotes schedule of reviews In regulsr 
class hours^ 


X 










e(l7,l>-l 


Denotes reviews (scheduled or 'unscheduled) 
for which special Materials will be pre- 
pare d^ 






X 




X 


t(21,l>-l 
• (2l,2>-l 


S:>ecial. instructors will be provided for 
the slow tracks 
.••for thefast tracks 




X 
X 








«<25,l).l 


Students will be rewarded for achieveflwnt 
In « variably paced course^. 


X 










•(26.1)»1 or 2 or 
e(2M)«l.or 2 


IXtnotes exaMinations which. will require 
an* instructor or clerk as.proctor^ 




>x 









*Hp direct^ effects. . 



Choice of variable depends upon the' basis of exitMinatibn schedule; 



y. LOGICAL STRUCTURE OF DISTAF 



This section describes parts of the DISTAF program whose logical structures 
are not immediately obvious. Strata decisions fall into four mcgor sectionsr 

1. General strategy. Decisions that affect the course as a whole. They can be 
made without referring to details of instructional method or course con- 
tent» and are a continuation of the policy decisions made in answering the 
Questionnaire for Stating General Policy described in Sec. IL 

2. Establishment of strategies for 7^ I instruction. This section establishes 
values for each subcat^ry of l^pe I instruction for the six primary 
strata variables discussed in Sec. ID: presenter, background materials, 
int^ated stimuli, recording responses, type of response, and feedback to 

^learner. Values are also established for adapter or pacer, as applicable. 
Other decisions relevant to Type I instruction are made. 

3. Establishment of strategies for J]ype II instruction. A similar, but more 
complex, process is followed for n instruction. 

4. Establishment of strategies for Type III instruction. The program has not 
been completed for Type in instruction. Its general features are sketched 
here. 

After the planner makes all decisions called for, the computer types out a text 
summarizix^ the strategies he selected. An example is shown in Appendix C. 

The order used in this section in describing program flow generally goes from 
the most specific (least enoompaising) to the niost general (moei encompaissing), so 
that the prbgrainV more compi» features can be biiilt up. We first describe the 
decision logic for deternunihg of j^e six prm^axy stratc^ variables fbr 

scheduled l^pe I idstructioh. l%ese viEUii^^ jfohn the core around which DISTAF 
is built. Their: values are set for aimpst cill cat^bries of ^istruction; many of the 
more general diM^ directed 1x)ward providing i^amework within which 
these values are set. 

Ai^r disc^^ varifJbies relating to scheduled Type I 

iiistnic^oh are dete^r^^ ¥i^ disctu»^^^ deasi6h;l(^c for aU Type I instruction. 
The discussion of T^pe n instnictiqn parallels that of iC but largely concerns 
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those points wherein the two decision flows differ; similarly, for Type III instruction. 
Finally, the general strategy of the first section is treated. 



STRATEGIES FOR SCHEDULED TYPE I INSTRUCTION 
Presentation 

For Type I instruction, the computer directs the planner to choose the presenter 
which can be an instructor, student leader, any appropriate communication 
medium, fixed-duration program, response-paced program, or adaptive program. If 
the planner chooses an instructor for this role, he is next asked to decide whether 
he wants to supply the instructor with background materials, i.e., references, lesson 
guides, and instructional aids from which the instructor may draw his presentation. 
If the planner chooses not to supply such materials he next is asked to determine 
whether to use the appropriate communication medium to make presentations 
requiring special equipment or a special facility. Then this phase of the decision 
process is crver. 

If the planner chooses to supply background materials, however, the decision 
process continues, as illustrated on the flow chart of Fig. 4a at (6)," (9), and (12H14). 
The planner is next asked to decide whether to integrate stimuli for overt student 
response with the presentation (integrated stimuli) (6). If not, the decision on presen- 
tations with special requirements (13) is made next, as before. If stimuli are inte- 
grated, however, the planner is directed to designate what type of response should 
be elicited (selected or constructed) (9), to determine whether to give examples of 
acceptable answers to the learner after he has had a chance to respond (feedback 
to the learner) (9), and to determine whether to record the leanier^s responses 
(recording responses) (12). Again, presentations vntfa special requirements must be 
considered [(13) and (14)] before this phase of the decision process is complete. 

If the planner chooses a student leader as the presenter (4), the decision process 
is essentially the same except that the computer automatically decides that back- 
ground materials will be supplied, as indicated by the upper rectangle surrounded 
by the double line in the center (5),of P^. 4a. 

If the planner chooses any appropriate conmumca^ medium or a fixed-dura- 
tion program as the presenter (^, a communication medium carries the burden of 
instruction, making the decision on biuskgro irrelevant and therefore 

the computer skips it Additiondly, preMntations with spedal requirements are 
automatically made by a coinmunioation Qiediiim or fixed-duration prdgi^am, which- 
ever is chosen for presentation (8). The remainder of the decision process is ibe same 
^ as before. 

If the plimner chooses either a reeqponse-iw^ pirpgram or an adaptive program 
as the presenter, the computer sets four vartobles automatically, as indicated by (11): 

IS Figures iii parenthem refiur to steps in the 0x>w chart 
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Ytt 





(5) 

stu4«nt iMdtr 
suppi l«d with 
lACKCKOUND 
HATCKIALS 



ytt 



mnmi. vtth 
spxciAL uq. by 
OOIM. HQ), or 

nnx>-nm* kh* 



yts 



^STIMULI for> 
''ovtrt rtsponst 
imCKATCO with 
kpr«s«nt«tlont^ 



(9) 

Indlcatt TYPE 
of RESPONSE; 
If FCEOMCK to 
LEAMER 



(10) 
pratantar It. 

RESPONSE* 
PACEP P6N» or 
ADAPTIVE PCH» 



(XX) 
STIMDLI Ilfr«$ 
ULECICD U8F«$ 
raDIAOCTO 
UAWa; 

pjtsBifnf* vtth 
snc» jtiQ* by 
asr»-KD» fan* 
9t ADAmvi rcM, 



(12) 

daclda If 
RESPONSES 
RECORDED 



m 

choota Mains 
for PRSENTN. 
Mith SPECrAL 
REOglREHENTS 




To naxt phase 
of .dacUton 
process 



Fig. 4a--I)edmoii sequence for presentation 
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DESCRIPTION OF SYMBOLS USED 



Rectangle-^ process that the planner carries 
out while seated at the console and interacting 
with the computer, e.g,, choose presenter^ (1) on 
Pig- 4a. The process is described briefly within 
the rectangle. 




,er|c 



Rectangie with double line— the computer pro- 
gram automatically establishes strat^ on the 
basis of the designer's decisions* e.g., student 
leader willbe supplied with background mate- 
rials, {5) on Vig. Asl. 



Diamond— di decision that the p/anner makes 
that causes the program to tedce alternative 
routes, e-g,, (3) on Fig. 4a 



Diamond with double line-^a point at which 
the computer prosi^mchooses altematft routes 
according to prior decisions, e.g., (2) on Fig. 4a. 



Dashed symboh-ei repeat of a i^bol on a 
preceding figure as an aid to orienting the 
reader. 



Arrow—program flow, which in general is 
downward and to the right. 



Variables within rectangles or diamonds— 
. their values are set at that point. 



Numbers adjacent to symbqla-^refeT: to state- 
ments in the manual that accompanies the pro- 
grcun; These ste present considerations 
that will assist the designer in making the deci- 
sions called fdr. 
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stimuli for overt responae must be integrated with the presentation; selected re- 
sponses must be called for; the learner must receive acceptable responses; a re- 
sponse-paced program or an adaptive program must make presentations with spe- 
cial requirements* After the planner determines whether to record responses, this 
phase of the decision process is over* 

For readers who wish to follow the program in grater detail, Fig* 4a is repro- 
du.'^ in Fig* 4b, in which the nac:e8 of the strata variables replace the statements 
in the rectanc^es and diamonds, and the related statements in the User's Manual 
(Appendix B) are shown alongside the rectangles and diamonds. 

Variable Pacing 

If the planner chooses variable pacing to adapt scheduled instruction to student 
learning rate, he first h asked to choose the pacen instructor, response-paced pro- 
gram, student leader, or I^samer* Each choice automatically determines a presenten 
as shown in (4), CO, (10), and (13) in Fig* 6a* 

If the pacer is an instructor (3), theplanner is asked to decide whether to group 
students by learning rate (2) and, if so, to choose the number of levels of learning 
rate that be wishes to accommodate (5)* Next, he determines whether the instructor 
will be provided with background materials that are programmed (11) and thus have 
integrated stimuli (14). Whatever his choices here, the computer next directs him 
to the decision process for setting values of presentation variables (symbolized by the 
dashed rectanj^e) just below the upper left rectangle of Fig* 4a; that is, just after the 
choice of presenter* The computer leads him through this process, skipping all 
decisions that have already been made* For example, the planner choosesio l)rovide 
the instructor with programmed background materials, stimuli are integrated, and 
the computer skips that decision* It also skips the decision on background materials, 
since programmed background materials are, ipso facto, background materials* 

If the pacer is a response-paced program (Q, the presenter is a response-paced 
program, and the flow through the grouping dedsions is the same as above* There- 
after, the process goes directly to Fig* 4a; the only decision not skipped on Fig. 4a 
is whether to record student responses* 

If the pacer is a student le^er (9), he must be supplied with programmed 
background materials (10). These include stimuli for overt student response so that 
the student will know how to pace the leanier<sX Again, the grouping decisions are 
made and presentation variables are set; all variables whose values have been 
determined are skipped, as before* 

If the pacer is tlie learner (12), whatever communication media are appropriate 
are prpgranmied (13) with intes^ted stimuli, and must provide the learner with 
models of acceptable responses so that he knows how to pace himself* There can be 
no grouping by learning rate; of course* j 
, , / Figure 5b relates the decidoh sequence for variable pacing to the program and 
manual* 
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(I) 

clioett 
9ACCK 






(12) 

N€«r It 
UMNCK 



muirra u 

INSTMKTM 



(7) 

pftnUr It 



(to) 

K*Mnt«r It 
STUDClfT UAOCKt 

MMI tNTCCMTCO 
STIMULI: 
>MCMMNI» 

tu^ll«% 



(13) 
VM»nUr It 

cmm* m^i 

>r«MnUtlofi 

vtM im«Mm 

STIMMII; ncO* 

•ACK to 
UARMCK; MO 
OOUflWt 







ft 


(5) 

choott mMUr 
of Lcvas of 
lotmlnff ratt 










(U) 

niMni 

IMTtMATCO 
with 
^fMOAtttlor. 



r-T-- 

I CllOOft 



Fig. 5ft--rI)ecidon seqpienoe for v^^ 
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Adaptive Method, Step I 



If the planner chooses to adapt the method of instruction to student capabilities 
in a more general way than by variable pacing alone, he must choose the adapter, 
whose role can be similar to that of the pacer. Choices for adapter are instructor, 
student leader, learner, and adaptive program, as shown in Kg, 6a- Unless the 
adapter is the instructor, the computer automatically determines the presenter, and 
sets some other values (6), (9), and (13). If the adapter is an instructor, a student 
leader, or the learner, the planner next is asked to decide whether my stratified 
materials (materials prepared on several levels of difficulty (2)) will ie used. If the 
adapter is an instructor (4), the presenter is chosen next (^, as the instructor may 
perform between-session adaptivity, and concurrent adaptivity may be performed 
by some other means. The choices for presenter in this casr^ are the same as those 
in Fig. 4a. If the presenter chosen is either an instructor or^dent leader (10), the 
planner decides whether to provide programmed (branching) background mataials 
(11) before entering the decision sequetfi^ in Kg, 4a* As before, the computer ,au* 
tomatically skips decisions relating to variables whose values iiave already been 
determined. 

Figure 6b relates the decision sequence for adaptive method to the program and 
the manual, as shown. 

Adaptive Method, Step n 

Actually, the decision sequence for the adaptive method is somewhat more 
general than that for variable pacing because decisions on grouping must precede 
the choice of adapter. This set of decisions is shown in Fig. 7a, which is largely 
selfexplanatory. Step (7), however, introduces a concept of program flow not dis- 
cussed previously— the return or loop, m which the computer has the planner repeat 
the same process &fr each track or group until he has determined strata for each 
one. 

It is implicit that if students are put into tracks instructiohal riJethod must be 
adapted to student learning capabilities for the entire course because each track is 
in essence a separate course. Alternatively, ability groups may be formed within 
classes or other aggr^tions of students. One choice is to treat each learner as an 
individual, that is, to form no ability groups. Whichever strategy is chosen, the 
adapter must be designated for ^h track or group for all individuals. 

As Fig. 7b shows, tliedeciid^ 
program and to the Questionnaire for Stating General Policy because the decision 
on tracking is nmde at the I^est level of genendity. 

The variable A(66), shown in the lower left diamond, is a flag whose value is 
automaticaUy assigned by the oompiutef. It keeps account of the group or track for 
which strategy k being des^el JThen its value reaches 3, strati^ has been set 
for all ^ups or tracks. 
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yes 




no 




For Mch TMCK 
or CKOUf 
or all 
INDtVIDUALS 




To n«xt phtM 
of rf«clslbn 
procMS 



Fig; 7a-^De(^qn sequence for adaptive method step 2 



64. 




Fig. 7b--Frogram flow for setting adaptivity variable9 (step 2) 
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Fixed Schedule 

If students must master course content on a fixed schedule, the planner is not 
allowed to choose either a student leader or the learner himself as either an adapter 
or pacer of scheduled instruction. This is so that the schedtde may be maintained. 
Because this limitation must be imposed at so many points in the program it is not 
shown explicitly on any of the flow charts. 

Decision Sequence for Scheduled Type I Instraction 

The decisions on adaptivity, variable pacing, and presentation just discussed 
follow each other as shown in Fig. 8a, This flow is a loop through which the planner 
passes twice, if necessary. First he decides whether he wants to consider two levels 
of subject matter difficidty (1). This gives him the chance to establish two separate 
strategics for T^ype I instruction, if he so desires. The program then has him enter 
a loop fyr establishing strategy for each level, b^ini^ witii the simplest. The 
program flow is identical for each levd^but the maniud provides the planner with 
different pros and cons to concdder for each level. After strategy is determined for 
the lowest level of difficulty, the program switches the planner back to the b^[inning 
of the loop if there is a higher level of difficulty to be considered (3). If not, this phase 
of the decision process is complete. 

Note that decisions on variable pacing (2) are made only if more generally 
adaptive methods are not used, although variable pacing is a consequence of most 
of the decisions possible under adaptive method. The computer goes directly to 
^decisions concerning presentation if neither adaptive method nor variable pacing is 
used. 

As in Fig. 7b, Fig. 8b contains a flag«variable [A(5)] whose value is automatically 
set by the computer. When decisions are being made concerning instruction on 
simple topics, A(5)=0; if they are difficult, A(5)=l. 



STRA'qSGIES FOR ALL TYPE I INSTRUCnON 

Figures Sa and 9b show the overall flow fd* setting strategies for Type I instruc- 
tion. We have discussed all parts of this flow except ita beginning and ending, Le., 
the establishment of examination and review strata' (D the wrap-up <[2). 

Wrap-Up of Type I biatrdction 

Because tJie flow throu^. the dejpends on decisions concerning sche- 

duled instruction, w|ich we Mve jii^ disinissed^ we treat the wrap-up fest This is 
shown in Fig. 10^ It mclude^ (1) scbrmg.claasw and iichedtding 

discussion sessions, which depend on:ihe piec^^ selectmg the 

type of tests fbir fomal ez^^ 
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study, which may be influenced by what the planner considered while setting the 
preceding strategy. V ^ ^ 

At a given level of difficulty student responses may be recorded and models of 
acceptable responsen may not be immediately provided to the student If this occurs 
for either level of difficulty (1), the planner may want to use the scoring of student 
classroom nork (classwork) as an opportimity for additional instruction in class or 
as informaticm on student progress. Kstudent classroom work is not scored in class 
(2), the type of response elicitedowill determine the next decision to be made (3). If 
the responses are constructed, the instructor may score them during his work day, 
after school, or not at all. If the responses are selected, they may be machine scored 
or the instructor may score them, the latter task occupying only a brief time. 

If at both levels of difficulty answers are provided to stimuli for overt student 
response, there is no need for special sessions to 5co/«student work because students 
can compare their answers with those provided as they go along. Therefore the 
computer will have the planner^ bypass this section. 

Students may still need to discuss their work, if they have been working in- 
dependently of the iiistructor or the student leader. Therefore, if at either level of 
difficulty instruction is not presented live, the planner may want to schedule discus- 
sion sessions following the presentation to claAfy points and to answer questions as 
necessary (5). (W e assume that if an instructor or student leader makes the presenta- 
tion, students will have an opportunity to discuss the material with him.) In addi- 
tion, it may be desirable to review the presentation by discussing it in a class group, 
a standard procedure in many classrooms. If the planner decides to schedule sepa- 
rate discussion sessions, he is asked to estimate the time they will take as a percent- 
age of basic presentation time and specify the ground rules for scheduling the 
sessions (6). 

The planner next decides how much objective testing, he wants to do. If he 
decides to use selected student responses in any portions of l^yP^ I instruction, he 
inay quite naturally decide that formal examinations will be objective test^, Le., call 
for selected responses (7). If some or all of Type I instruction calls for constructed 
responses, however (or for no overt response), he nuiy be reluctant to use objective 
tests as formal examinations. Similarly, the means he chooses for presenting formal 
examinations (7) will be influenced by his choices of the means forba^ic instruction. 
In this program the means for presenting review materials is assunied to be the 
same as that for presenting formal evaluations of the students' mastery of these 
materials. 

The decisions on unscheduled study (8X13) pennit the design of instruction to 
be almost as varied in this m(>de as do ^ose fqrsc^edideds^ The limitations are 
a live instructor or.class monitor cannot pnyipnt iifti^igpmpwhf^ >fi)r| that the 
St. «;nt is assumed tio be studying as an individu^^ on unschedided study 

niay depend on streiegy for sbheduled's^^ opted 
for mdividually respona^^ iwhediUed i:^^ to 

useihe fame eqmiment for^ Bedauc^ choices for the pre- 
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random access to the materials (11). Decisions on whether and how assignments for 
unscheduled study are checked and discussed (13) complete this phase of the decision 
process. 

Figure 10b, which shows the program flow for Fig. 10a, requires some explana- 
tion. The setKlirection for statement 38 (upper right rectangle) applies to variable 
A(10) if ^9)=0 or to A(59) if —(9)= 1. For simpUcity, this additional branch was not 
shown on Fig. 10a. Similarly, if A(17)=l, variables M12\ A(18X A(56X and A(77) are 
set (next line down), but if A(17)=2, variables A(20) and A(22) are set 

Examinations and Review 

Returning to Fig. 9a, we see that the first decisions coacerning Type I strata 
involve examinations and review. The decision flow is shown on Fig. 11a. Smce Types 
I and n are classroom instruction, student mastery of course content can be tested 
without the use of special facilities or equipment Therefore, a single strategy for 
ex a min a t ions and reviews can be applied reasonably to both types of instruction at 
once.- Examination and review sfiiitegies for T^pe m instruction, however, must be 
established separately. Thus, tiie decision sequence on Fig. 11a establishes strata 
for both Type I and Type 11 ins^^on. 

If the.planner .wants course content mastered on a fixed schedule (1), the com- 
puter clire^ him^to^eetablish the basis for the examination schedule; that is, 
whether examination frequencies should be geared to course content or to the 
calendar (2). If the schedule is not fixed, the only reasonable hms is course content, 
as it may hot be possible to predict where students will be in the course at a 
particular time. 

Next, the planner designates the frequencies of examinations (3), establishing 
their average length in minutes, the extent of course content tiiey will cover, and 
the level of proctor the examination requires (4). He then determines when examina- 
tions will be scored (during the worki^ day or after it) and how (by instructor or 
machine, if selected responses are called for) (5). 

The next set of strat^es concerns review (6). Usually a course designer does 
not explicitly consider the way reviews are going to be conducted, but relies on the 
iiistructor to provide reyiewis as they are needed Fixr sysbdm design, the time and 
means for review must be explicitiy consif!ered: iPhe planner Sxst determines 
whether or not to schedule reviews before all examinations (7). If not, he designates 
what type of examinatbns (daily quiz, final examination, etc.) to precede by reviews 
(8) and the review strateebT for 4ach type— that is, whether the review is conducted 
during scheduled instTU(^oiml hoiirb (9) or unscheduled study, whether materials 
are provided especially for i^e review (11), and an estimate of the average time 
required; if the review is carried but during scheduled study (10). 

The program flow on Fig. lib is higUy (MhdcnAsd. A(4) established tlie basis for 
the examination schedule. If A(4)=l/the set of double-subscripted e-variables for 
which i= 1 to 3 lis involved in the decision process (upper or left sides of dashed lines). 
If A(4)r=0, the other set of e*variables is used. The statement '"For each i=:l to 3, 
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if e(14)=l'* means that the subsequent decisions are made for each set of ezamina* 
tions administered at a given frequency [e(14)= 1]. If examinations are no^ adminis- 
tered [say e(l,l)=l] at a given frequency, the computer goes to the next value of i. 

Setting the review strategyinvolvesa8imilarprocess.IfA(ll)==l,thecomputer - 
sets e(114) [or e(134)]=l for each i for which e(14) [or e(24)]=l. If A(ll)=2, the 
planner is asked to set these values himself. Then the subsequent decisions are made 
for each set of reviews planned at 'a given frequency [e(ll,i)=l]. 



STRATEGIES FOR TYPE H INSTRUCTION 

As before, we first discuss how strat^es are established for scheduled instruc- 
tion, working ftx)m the more specific to the more general. Then we trace the flows 
for establishing strat^es fi>r unscheduled study, discussions of scheduled instruct 
tion, formal examinations, and review. 

Scheduled Type n Instracti<m 

Because in1^ninstnictionstudentsarelearningskills,theirovertresponses 
are actually the subject matter of what is being taught Hence, the computer desig- 
nates that Type n instruction integrate stimuli with the presentation, as shown in 
(1) on Kg. 12a. To provide the necessary routing for later decisions, the planner first 
decides whether to use foUow-me demonstrations in^ teaching the skills (2). 

Since student response* is the key toTVpeH instruction, the fypeofrtsponsethat 
is beingsought is of primary importance. Almost without exception, tte skills tau^t 
require constructed stitdent.responses. Even so, there may be instances when stu- 
dent mastery can be checked and diagnosed by selected responses. Arithmetic is an 
obvious example. Since the planner may want' to set strata for both contingencies 
(3), he passes through the s^me basic sequence for both [(4M7) and (8X11)]. 

If constructed responses are needed (4), the planner designates values .for 
strata variables having to do Witii presenting directions and stimuli for student 
performahpe (5). Hie decision sequence encapsulated in (5) is similar to that shown 
on Figs. 4a, 5a, or 6a, as appropriate. The major difference is tihat since stimuli are 
int^^ted (1) end constructed responses are needed (4), the computer has the plan- 
ner skip these decisions [(5).and part of (7) on Pig. 4a]. In addition, since studente 
are learning cddlls that do not require special facilities or equipment, presentations 
of those skills do not have special reqiiiremehte. Hence, the compter also skips (11) 
on Fig. 4aL The planner is therefore Ifft with choosing the presenter (or pacer of 
adapter, as appHcabH making diedsions on the types of background materials to 
be used if the presenter is an instructor &r studeiit leader, and deciding whether or 
not to give feedback to the leaniefimd whether or not his r^ponses will be recorded. 

Returning to Fig. 12a, the computer checks whetiber the i lanner wante to use 
<follow-me demonstrations (6); if so^ the planner iiext chooses the leader for these (7). 
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He then goes through the same sequence if selected responses are used (8X11). 
Although the flow is the same for both constructed and selected responses, the 
choices for presenter (or pacer or adapter) are different This is because response- 
paced or adaptive programs can be used only if selected responses are called for. 
Figure 12b is self^ezplanatoiy. 



I^TC n bistructioii, Individaal Skills 

The decision flow of Kg. 12a is embedded in Kg. 13a, which shows the decision 
flow for all of Type II instruction that teaches individual skills. Although most 
clasOTOom teaching is aimed at developing individual skills, some classroom skills 
require teamwork or other group interaction.^ Participating in group discussion, 
reading a part in a play, or playing a game that does not require special fecilities 
or equipment are all interactive skills in Type H instruction. It is important to 
separate them from individual skills because communication media are much less 
useful for interactive performance. Hence, Kg. 13a b^ins by asking the planner 
whether any individual skills wiU be tau^t (1). If so, the computer checks to see 
whether examination and review strategies are aheady established (2). As men- 
tioned, this will be the case if I instruction is included in the course. If not, 
eramination and review strate^es are established (3) using the decision sequ-^ce 
of Kg. 11a. 

Next, the planner identifies the levels of skill complexity to be tau^t (3). He 
may choose either or both of two levels: rdativefy ample and i^atively conqto. 
A relatively complex skill requires studoit mastery of a set of infeiTe/btoi skills 
(such as a checkout procedure). Students may master a relatively simple skill on the 
first trial or may driU by repeatedly responding to stimuli that an instructor or a 
presentation device provides. 

The decision flows for simple and for complex skills are thesame, except at one 
point (4). If the the skills are relatively simple, we assume ftat tAey cannot be 
demonstrated or directed in any practical way step by step. 31ierefi)re, the decision 
about whether to include follow^e demonstrations (§) is made only for relatively 
comply sidlls. 

Next, the planner designates the types .of respmises he wants elicited (6). If 
students perform any skills of the given level of complexity during scheduled study 
(^, the computer directs the planner through the decision flow of Kg. 12a, beginning 
with (4). If not, the computM^dSRects him to establish strategies for demonstration 
and unscheduled study (8). This flow is discussed shdrfly. ' 

If strata has not been set for each level of complexity (9), the computer directs 
the planner back throuj^h the decisions beginning with (4X If strategy has been set 
for each level, he proceeds to the vwapnip of "^yje E instruction, individual skills 
(10), and thence to the next phase of the dedsion process. The flow for (10) is also 
discussed shortly. 

Kgure 13b contains another flag-variable, A(41), that the computer automati- 
cally sets. If A(41) = 1 , the planner is making decisions concemiiig relatively complex 
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Fig. 12b— Program flow for setting variables for scheduled Type U instructioii 
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Fig. 13b— Program flow for setting variables for Type n instruction, 

individual skills 



skais. If A(41)=0, relatively simpleskills are being considered. If A(41)=0, e(9,l) and 
e(9,2) are set and tested in the lower part of the chart, If A(41)= 1, e(10,l) and e(10^) 
* are involved. 

Demonatrations of Models of Performance and Unscheduled Study, 
Individual Skills. 

Decisions concerning demonstration and unscheduled study are made for each 
level of skills taught (Fig. 14a). If decisions concern relatively complex skills or if 
the planner indicates that any student performance will be carried out during 
scheduled study (1), thie.computer automatically determines that all presentations 
of models of performance are made during scheduled study (2). This is because of the 
importance of initiating students to the skills they are to master. Otherwise, the 
planner may decide whether such presentations are presented during unscheduled 
study (3). In any case, the presenter of models of performance is chosen next (4). 

If any performance is asagned for unscheduled study (5), the planner is routed 
through two separate sequences, one for skills that jMsnnit selected response (© and 
(7), and one for those that do not (8) and (9). Then the same sequence of decisions 
on random access, :scheduling discussions of assignments, and so on, that were 
required for Type I instruction is fcilowed, b^^inning with (11) of Pig. 10a. 

The planner is then routed to (9) of Fig* 13a to repeat the sequence if strata 
is not set for each level of complexity, or if it has, to wrap-up Type n instruction. 

The text discussing Fig. 13b also applies to Fig. 14b. 

Wrap-Up of Type H Instruction, Individual SHUs 

The flow for the wrap-up of T^ n instruction for individual skills is similar 
to that shown on Pig. 10a for Type I instruction. Changes are as follows: If strategy 
is e^lished for scoring deskwork [(1X3) on Pig. 10a] or for discussing i^edia 
presentations [(4H6) on Pig. 10a] in the courae of setting Type I strata, the t^me 
strata is applied to T^pe n instruction where appropriate. Therefore, thea? deci- 
sions would not have to be made again; Also, because the. decisions concerjjng 
unscheduled stndy will ahea4y have been made, the decision sequence [(8H13) on 
Pig. 10a] is deleted- 

Type n Instruction, Interactive Skills 

The decision sequence in Fig. 15 concerns teaching interactive skills in Type n 
instruction. Since the essential part of this injstructioh involves groups of students 
working together, the only requirements for communication media are to provide 
models of the skills to be mastered [(1) and (2)] and to record student performance 
[(3) and (4)]. We assume thkt ill instruction in interactive skills takes place during 
scheduled study because of the difficiilties of coordinating student performance for 
unscheduled '^dy. No strata for formal evaluation of interactive skills is pro- 
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vided, because we assume that whatever evaluation is done would be provided on 
the spot by the instructor or upon review of recorded student performance. 
The program for this decision sequence has not yet been written. 



STRATEGIES FOR TYPE m INSTRUCTION 

Although the program for l^pe m instruction is not worked out, the general 
structure is fairly clear and similariti^ and differences among the three .types of 
instruction can be noted. Rrst, because Type EI instruction is directed toward 
developing skills, it will be similar to Type n instruction as far as the logical 
structure of the decision process is concerned. Therefore, decisions will be needed 
concemmg the complexity of skills, the type of response for checking and diagnosing 
student mastery, the need for demonstrations, and the possible requirement for 
follow*me demonstrations for complex skills. The flow of these decisions will be 
essentially the same as that for Type 11 instruction. 

There will be some differences, though. First, a dull demonstration for Type n 
instruction will never require the use of special facilities or equipment; however, 
initial skill demonstrations taught by Type III instruction wiU always require the 
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use of special facilities or equipment. If these demonstrations are presented by a 
communication medium (rather than live), they may be shown in the classroom and 
will be similar in their requirements for system support to Type I presentations that 
require special facilities or equipment But unlike T^pe I presentations, the facilities 
and equipment required for the demonstration will always be available at the school. 
Therefoiw, uollar savings vnU be of less concern than considerations of effectiveness 
in deciding whether the demonstration should be given live. The average instructor 
may be relatively inept at structuring and explaining a demonstration; in that case, 
other means for accomplishing this crucial step may be preferable. 

In follow-me demonstrations of complex skills, each student requires access to 
the special fitcilities or equipment needed to execute the skill. Therefore, these 
communications must be given in the appropriate environment. If that environment 
demands tb . presence of an instructor or monitor to assure the safety of students, 
the'equipment, or the surrounding area, the most reasonable choice for the pre- 
senter may well be the instructor or monitor. Whether or not his presentation is 
prepared for him in advance then becomes the important issue as far as communica- 
tion media systems are concerned. If an instructor is not reqiiirc3d and individual 
skills are taught, communication media systems can be highly effective when used 
for foUow-me demonstrations. 

The considerations for teaching interactive skills in T^pe HI instruction are 
similar to those for Type 11. The imgor diffference vsrill be determining whether 
demonstrations should be executed in the 1^ HI environment or whether they 
would be more eff*ective via a communication medium. 

Not all student responses in l^pe m instruction ar3 necessarily constructed. 
For example, selected responses can olften be used to trace the student's progress 
through a checkout procedure or to determine whether he can identify the location 
of particular equipment on an aircraft (The latter aictivity could be considered Type 
I instruction if the designer does hot feel that experience with an actual aircraft is 
essential to learning:) By and large, however, student responses in Type HI instruc- 
tion are constructed and require the judgment of an instructor, monitor, student 
leader, or the student himself to assess their nghthess. Determining how to provide 
this feedback to the student is thus an essential part of the system design. Communi- 
cation media can often be used to provide models of accepted practice; they cannot 
be used to assess the acceptability of the students' responses. 

The strata for 'mscheduled study will depend heavily on the school's policy 
with regard to unscheduled student access to special facilities or equipment needed. 
Where safety is a consideration, probably no unscheduled study will be planned. If 
safety is not an issue, the expense of keeping focilities open or of making equipment 
available may be a deterrent. Students who are turned on by the Type HI instruction 
(and many students find this type of training highly stimulating) may well want to 
work extra hours with the equipment. The same arguments apply to the decision 
about whether review should be scheduled or unscheduled. 

An important issue in technical training concerns the formal examination for 
Type m instruction. In many instances no time is set aside specifically for such 
examination; rather, the instructor is expected to judge the students' competence 
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during the course. Although tliis may be an effective solution if the instructor is 
trained to observe completely and objectively, most instructors an^ probably not as 
competent in this respect as would be desirable. Job performance tests, however, are 
notoriously expensive to administer and difficult to score reliably. Reliable scoring 
may require a team of observers, adding more expense. Lacking the analysis that 
would show whether such elaborate tests are worth their cost in the long run, we 
must rely on the informed judgment of the planner at this point 



GENERAL STRATEGIES 

Figure 16a shows the decision flow for setting general strategiv'M. As mentioned 
earlier, DISTAF treats adaptivity of two different kind&-adaptiri; course content 
and adapting instructional method. The planner may choose to adapt course content 
to student background ^in answering the Questionnaire for Stating General Polipy 
(1); if so, the computer directs him to choose the basis for selecting students for the 
modified courses (2). If not, the computer checks whether the planner wants to adapt 
teaching method to student capabilities (3), a decision he will also have made in 
answering the Questionnaire. 

If the planner chooses to adapt the instructional method, the computer next 
checks to see whether he also chooses to use tracking (4). Without tracks, the planner 
may decide to adapt teaching method for only parts of the course (6) because he 
wants all students to share certain learning experiences. For example he may feel 
that a particularly skillflil instructor in his school should teach a part of the course 
to every student who takes it because this instructor is adept at motivating students. 

If students are put into tracks, the planner may wish to use an instructor with 
a special background for a slow track or for a fast track (5). Jf a special instructor 
is selected for the slow track, it is assumed that he will be responsible for desiifning 
the instruction appropriate for his class. For the bright group, the student himself 
or perhaps a student leader can be responsible for adapting the way he learns to 
what he learns. If tracking is not chosen (presumably because the designer wants 
to preserve an option to adjust groupings to the type and difficulty of the instruction), 
it is probable that scheduling difficulties will make it too inconvenient to hire special 
instructors for brighter or slower grdups as the instruction requires. 

In Stating General FqUcy, the plai^ier may decide to allow slower students to 
repeat portions of the course or to receive remedial instniction as needed. If so (7), 
the computer directs the planner to provide either remedial instruction or to allow 
repeats or both. If he provides remedial instruction (8), he next decides whether to 
give it in scheduled sessions or to assign it for unscheduled study (9). For scheduled 
remedial sessions he chooses the presenter and estimates the time the session will 
require (11). For unscheduled remedial sessions, no decisions are necessary; these 
sessions will be conducted in the same way as other unscheduled study (10). 

Again, the computer checks to see whether teaching method will be adapted to 
student capabilities (12). If not, the planner may choose at least the limited adap- 
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tivity offered by variable pacing (13). If he does, the planner must establish a 
strata for rewarding students who complete their studies (14). Rewards may be 
needed to provide continuous, high motivation in many school situations. Finally, 
the planner identifies the types of instruction CTypes I, U, and IID for his course (15). 
This completes this phase of the decision process. 
Figure 16b is self-explanatory. 

Shortcuts in the Decision Process 

Throughout the program are points at which the planner may apply a strata 
he has set previously to the instruction under consideration or he may devise a new 
strata for it. If the applicable strategy was just set, the computer asks if the 
planner wants to change it If the applicable strata was set several steps before, 
the computer types out a few phrases to remind ^e planner of the applicable 
strat^. 

This device was introduced so that a planner does not have to work throu^ all 
decisions if he does not wish to do so, To make it a reasonable tactic, we identified 
the types of instruction thut are sufficiently^ similar that a planner niight want to 
use the same strata for both. TdAe 6 shows the matchings currently built into the 
program. The column headed key variableCs) lists the main variable(s) the planner 
should consider in decidiiig whether or not to apply the same strata to similar 
instruction. If tiie key variables are a/( the program sets all decision variables in 
the similar instruction equal to those in the instruction with established strat^. 
nrthe key variables are not all, only dert£^ sets of variables are changed. These are 
discussed shortly. The column headed program mniiufer?notes whether or not the 
computer recalls the previous decisions on the key variables for the planner. 

Similarity is determined primarily on the ba^ of type of instruction (lines 1, 
2, 12, IS) and level of diiBicuIty (lines 3 to 11). Currently, simple Type n is treated 
as though it were relatively ewy; complex Type JU as difficult Presentation of 
models of performance in T^pe n instruction Qines 14 to 17) are an exception. Here, 
the presentation is assumed to be similar to the instruction requiring constructed 
response (if the planner has daacribed any) because that instruction usually requires 
more latitude in presentation and because demonstration dees not call for response. 
If there is no TyfeU instruction (simple or complex) requiring constructed response, 
the demonstration is assumed similar to the Type I instruction of a similar level of 
difficulty. 

If the applicable strategy has not been established, as would be the case, for 
example, if no difficult l^ype I instruction was in llie course but complex Type n was 
(lines 4, 5, 7, 9, 11, 17), then the program skips the question iand heffns determining 
strata for iha instruction at hand. Other reasons for skipping the "similar 
strat^y"' questions are the following: 

• A decision not to adapt teaching method in T^pe I instruction but to do so 
in Type II, or vice versa (lines 3 and 4). 
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Table 6 

lyPES OF INSTRUCTION MATCHED FOR DECIDING STRATEGY CHANGES 



Instruction with 
Established Strategy 


Similar Instruction; 
Strategy to be 
Established 


Key Variable(s)- 


Program 
Reminder? 


I. Easy Type I 


Difficult Type I 


All 


No 


2. Simple Type II 


Complex Type II 


All 


No 


3. Easy Type I 


Single Type II 


Grouping 


Yes 


4. Difficult Type I 


Complex Type II 


Grouping 


Yes 


S. Difficult Type I 


Complex Type II 


Variable pacing 


Yes 


6. Easy Type I 


Simple Type II with 
constructed response; 

Simple Type II with 
selected^ response 


Adaptor and 
presenter for 
each group 


Yes 


7. Difficult Type I 


Complex Type II with 
constructed response; 

Complex Type II with 
selected response 


Adaptor and 
presenter for 
each group 


Yes 


8» Easy Type I 


Simple Type II with 
constructed response; 

Simple Type II with 
selected response 


Pacer and presenter 


Yes 


9. Difficult Type I 


Complex Type II with 
constructed response; 

Complex Type II with 
selected response 


Pacer and presenter 


Yes 


10. Easy Type I 

- 


Simple Type II with 
constructed response; 

Simple Type II with 
selected response. 


Presenter 


Yes 


IK Difficult Type I 


Complex Type II with 
constructed response; 

Complex Type II with 
selected response 


Presenter 


Yes 


12. Simple Type II with 

constructed response 


Simple Type II with 
selected response 


All 


No 


13. Complex Type II with 

constructed response 


Complex Type II with 
selected response 


All 


No 


14. Simple Type II with 

constructed response * 


Presentation of models, 
simple Type II 


Presentation 


Yes 


15. Easy Type I 


Presentation of models, 
simple Type II 


Presentation 


Yes 


16. Complex Type II with 

constructed .response 


Presentation of models, 
complex Type II 


Presentation 


Yes 


17. Difficult Type X 


Presentation of models, 
complex Type II 


P.resentation 


Yes 
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• Establishment of one set of groups to facilitate adapting teaching method 
for l^pe I instruction and a different set for l^pe n Gines 6 and 7). 

• A decision not to use variable pacing in Typ^ ^ instruction but to do so in 
Type n, or vice versa (lines 8 and 9). 

• Use of a presentation method that requires selected response (such as a 
teachmg machine) in Type I instruction Oines 6 through 11). 

The parallel question to line 5 that would match average-to*easy Type I instruc- 
tion with simple Type U in inquiring whether variable pacing is to be used does not 
appear because simple Type n instruction can include drills in which variable 
pacing is used initially until the student learns the correct responses. Then a fixed 
pace is used to bring the student up to some desired rate of response (speed drills). 
This introduces a variation that reduces the similarity of average-to-easy TyP^ I 
instruction to simple Type n instruction. 

If a fo!low-me demonstiation^is used in complex Type n instruction, its particu- 
lar requirements ^uld be coniridered separately, not as jmrt of the.complex Type 
n package. Therefore, line 13 is skipped if foUow-me demonstrations are used 

We have hot fully determined which strategiee in Types l and 11 instruction are 
similar to those in Type III instruction. At tliis point, the decision concerning presen- 
tations of I instruction that require special facilities or equipment seems to be 
the only one appficable to Type m instruction. it would, of course, be similar to the 
decision concerning pure demonstration, but since the &cilities or equipment re- 
quired for the demonstiatiou would be availd>le, the considerations would be differ- 
ent. 

Several other assumptions were lised to keep the number of "similar strat^' 
questions to a reasonable level. For example, if the designer establishes groups to 
facilitate adapting instructional method, it is assimaed that he will want to consider 
each group separately in establi^iing strat^. He may establish the same strata 
for each group if he wishes, but this decision is not fecilitated by "similar strategy" 
questions. 
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VI. CONCLUDING REMARKS 



PRESENT STATUS OP THE DECISION PROCESS 

The work described in this report has reached a point where it can help people 
involved in plimning and designing prdgranas of instructiori. There are at least three 
areas in which further development would be profitable, however 

• Extracting the details of tlie decision process for Type UL instruction, i.e., 
student perfonnance in Especial facilities or with special equipment. 

• Seprogramming DISTAF in a more generally accessible language. 

• Subjecting the decision process to field evaluation by potential users to 
assure its utility. 

As noted earlier, setting strata for T^pe III instruction will probably follow 
much the same logic as that for Type H. There is a point of significant difference, , 
however, in that it is difficult to evaluate student mastery of Type HI instruction' 
reliably and inexpensively. Consequently, evaluation is often slighted in planning 
this type of instruction; frequently, such evaluation is left to the discretion of the 
individual instructor, which is hardly an assurance against biased results. There- 
fore, for Type m instruction a set of alternatives to this approach needs to be devised 
and included as part of the design methodology. Wherever possible,^ the use of 
technological aids to evaluation \dll be among the alternatives available. 

At present, DISTAF is programmed in JOSS, a language that is not widely 
accessible. To improve accessibility, the Rand team is reprogramming DISTAF into 
Interactive FORTRAN, a language that will be usahle on many time-shared cfystems 
^d that is more versatile than BASIC, the other widely used language of time- 
^shared systems. 

V^^V^^y* potential users should test the decision process to determine whethen 

• Strata questions are stated in terms the user comprehends. 

• Strat^ questions are stated in ways that elicit positive and ianaginative 
responses. 

• All strata approaches of interest to users are included. 
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• The program contains enough reminders so that the user knows what he 
is working on at each decision point 

• The time required to learn the process is short. 



PRESENT USES OF THE DECISION PROCESS 

In its present state^ the decision process can be used in several ways. First, 
anyone can use it who has access to JOSS to specify strat^es of instruction that 
deal largely with subject matter suitable for the classroom. Strata specifications 
of these types can be useful in providing the ground rules for designing instruction 
using some of the newer technologies such as computer-assisted or computer-based 
instruction or cable television. 

iSven without the assistance of JOSS, the User's Manual provides a checklist of 
points to consider in planning and deigning programs pf instruction. By asseidi>ling, 
in one consistent ]^mdst of the considerations siirrouncUng appn)acheB 
to designmg prggrmns.of in^ should help assure the planner 

that he has dealt with all^si^iificant points in t^nns of resource use. 

Finally, the manual can be used in reverse; that is, as a checklist ibr describing 
actual instruction. In this role the manual can he|p to define observed teaching 
strat^es that link school resources to student lesuiiing. Siich definitions may assist 
in determining whether and how school fesoiirces affect studentjeaming, an issue 
that has been a matter of serious debate for some years." 

^* J. S. G/ieoum* et aL, Equality of^Educational Opportunity, VB. Department of Health, Education» 
and Welfare, U^. Office of Education, OE-dSOOl, Waelimgton, D.C., 1966. 



Appendix A 

QUESTIONNAIRE FOR STATING GENERAL POLICY 



As described in jSec. H, this Questionnaire enables the planner to consider poli- 
cies in three general areas: the broad characterization of the teaching institution's 
goals, the extent to which the schools will adjust to variations in the student popula- 
tion, and the way in which the schools must accommodate their operations to the 
needs of organizations that supply ttieir students or accept their graduates. Each of 
the 17 questions have "yes" or "no" answers, with directions to follow according to 
the answer given. 

As you go throu^ the Questiotmaire, you may be asked at certain points to 
check numbered boxes on the chart below. If you answer qu^tion 13 "yes," you will 
be given further instructions about how complete this chart, which is a guide in 
preparing the course for the type of student population desired. If you do not answer 
question 13 "yes," you will not need this chart further. 



LEARNING 
CAPABILITY: 



BeHar 
Average 
Poorer 



METHOD 
CHANGES: 



Special for 
BeHer 



Special for 
Poorer 



Confenf 
Changei 



PREPARATION- FOR COURSE 



Skip Known 
PorKons 



Add 
Prerequisites 



CONTENT 
CHANGES: 





Supflrior - 


Average 


Inferior 




1 


A 


B 


C 


2 ) 
1 




D 




F 




3 


G 


H 


1 


4 



Enrichment 



Relax 
Requir^ents 



YES 



NO 



1. Will a standard number of 
instructional hours be 
required as input, re^urdless 
of course content or student 
capability? 



□ 
Stop 



□ ; 

Proceed 



2. Are standardized graduates 
desired? 



3. Will better students be 
encouraged to go beyond 
average achievement? 



□ 

Go to5 

□ 

Check box 2 
Proceed 



□ 
Proceed 

□ 

Check box 4 
Go to5 



Will requirements be relaxed 
for poorer students? 



Will exposure to course 
content be matched to prior 
student achievement? 



6. Will additional instruction 
be given to students who 
are deficient in course 
prerequiaites? 



Will students with superior 
preparation be allowed to 
skip topics they already 
know? 



Will different instructional 
strategies be deingned to 
match different student 
capabilities? 



□ 

Check box 4 
Proceed 

□ 
Proceed 

□ 

Check box 6 
Proceed 

□ 

Check box 5 

Proceed 

« 

□ 
Proceed 
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□ 

Proceed 

□ 
Go to8 

□ 

Check box 5 
Go to8 i 

□ 

Proceed 



If5== YESand2 = Y£S» 
go told 

If5 = yESand2=:NO. 
go toll 

If5^NOand2=:: YES» 
go to 14 

.If6 = NOand2=:NO. 
go to 12 



ERIC 



YES 



NO 



9. Will special strategies be 
used for better students? 



□ 

Check boxl 
Pit)ceed 



□ 

Check box 3 
If 5 = YES, go to 11 
Otherwise, go to 12 



10. Will special strategies be 
used for poorer students? 



Check box 3 
If 6 = YES, proceed 
Otherwise, go to 12 



If5 = YES, proceed 
Otherwise, go to 12 



11. Will students be put into 
tracks? 



□ 
Procedd 



□ 

Go to 14 



12. Will students be put into 
tracks on the ba^ of 
their learning capability? 



n 

If you answered 11, 
proceed 

If you did not answer 11, 
go to 17 



□ 

If you did not answer 11, 
go to 14 

If you answered 11^ 
go to 17 



13. Will students be put into 
tracks on the baids of - 
their preparation for 
the course? 



□ □ 

Follow directions on next Go to 17 

two pages to determine 

hovr' you want to put 

students into tracks 



Go to 17 



Unless you answered ''yes'' to question 13, skip this information. Refer to the 
first page of this Questionnaire and lightly shade all lettertdhoxes within the chart 
for which you have not entered a check in neither the corresponding numbered 
boxes at the sides of the rectangle nor in the corresponding .numbered box at the 
bottom. For example, if you entered a check in boxes 2 and 5, you would shade boxes 
as shown below (!.e., E, F, H, and D. 
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LEARNING 
CAPAWUTY: 



B«ft«r 
AveroQ* 



METHOD 
CHANGES: 



Special for 
B«tter 



SfMiciol foi^ 
Poorer 



Confonf 
ChQn9«s 



PREPARATION FOR COURSE 
Superior Averogt Inferior 




Skip Known 
Portions 



Add 
Proreqi^Ifltoi 



CONTENT 
CHANGES: 



Add 
Enrichmont 



Rolcx 
Roquiromonh 



The boxes you shade ropreaent studentB who will be taught all of the basic 
course contenfdby a method designed the student of avei^ge learning capability* 
These students are logical candidatM/f^ a single track (there may be several class- 
room groups within a track). 

Students in the unshaded boxes are candidates for other tracks* In forming 
these tracksl;:o^u will want to remember two principles. Fir^^ the objective of 
tracking is to facilitate instruction by fimning relatively homogeneous groups of 
students. Therefore^ you might hesitate to put students in box G in the same track 
with those in box A. Second, planning will be simplified and resource use more 
efficient if the number in oach track is greater than some minimum* What tins 
minimum should be depends on the average classroom size in the school For exam- 
ple, if classroom sizes fare around 10» a minimum of 5 might be reasonable, but if 
classroom sizes are around 90, perhaps a minimum of 15 might be reasonable. 

Finally, if you cannot reconcile the requirements of homogeneity and track size, 
you may want to group students mthin tracks or completely individualize instruc- 
tion to take account of student diffinences* 

After the tracking configuration is 'determined, designate what the configura- 
tion will be by listing the letters of the boxes that will form each track on the form 
below. After each set of letters, check whether or not within-track grouping will be 
us^ for that track* (Complete individualization will be considered to be a variant 
of within-track grouping*) 



Letters oTBon* in tnck 



Within-Track Grouping 
Y« No 



1. 
2. 
3. 
4. 
5. 
6. 
7. 
8. 
9. 



□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 



□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 



YES 



NO 



14. Will bMiccounecoatMt 
be preeented on « fixed 
■cbedule? 



□ 
Prooeed 



□ 

Stop 



15. Will additioad i 
in tb«/onn of nmedial 
iMtruct&n orwuhbaekbe 
ueed forelowitudeiitior 
•tudente mbo turn bees abeeat? 



□ 



□ 
ProoMd 



16. WUlfUlinfftudenttbe 
dropped finomthtcoom 
Wort iU ooodutkNi? 



17. Will biiicoottnecootMitbe 
pcmntad on a find lAedttle 

withtii 



□ 

Stop 
□ 

Go to 15 



□ 

Stop 
□ 

Stop 
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Appendix B 



USER'S MANUAL FOR SPEOFYmGmsmUCTIONAL 

STRATEGIES 



INTRODUCTION 

Paragraphs through<mt this manual ar« numbered to correspond 
the computer will give you to direct you to a particular topic at a particular point 
as you progress through the program* A few numbers have been ddpped to allow 
for possible expansion of the program* . 

1. In conjunction with the timenihared computer program/^this manual will 
help you specify the strategies you wish to use to teach the course described in your 
general Curriculum Analysis*-The decisions you have already made in filling out the 
Questionnaire for Stating General Policy and the characteristics of the expected 
student population will first be fed into the computer to guide tha timcmared- 
program* Therefore^ you will probably not be asked to make eveiy decision that 
appears in this manual because many will be irrelevant to your particular situation* 
Even 80, it would be wise for you t> read the nmnual careftiily before you sit down 
at the JOSS console so thft you will be sufficiently fiuniliar with the manual's 
contents to have a general idea of what to expect 

For ease of reading without >;x>mputer asristance, the manual treats decisions 
afiecting the entire course first, md then progresses through the various types of 
instruction at increasingly fin^* levels of detail* The computer program does not 
follow this order strictly, as it awms more natural to nuJce some decisions before 
making othen, even ti^uf^ the latter niay be more general than the foitner* 

If you use this manusl without direction from the computer, you will often 
encounter statements (such n 2^ describing adaptivity) that seeni putding because 
they refer to prior decisions you mi|^t have entered into the computer in an on-line 
run* For example^ statement 2 refers to a decisis entered from the Staten^ent d 
General I^olicy* 

Each statement in the manual is intended to perform two functioM^ 
the pros and cons of each choice that you may make at that point, and to iikUcate 
some consequences of each choice when the consequences are not immediately 
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obvious. Hopefully, this will help you to make your choices; for this reason, it is 
advisable to read the statements carefully as you progress through the program. 
Because this is a timeHshared computer program, you may take as long as you wish 
to make selections without incurring additional costs at the central processing unit 

The program helps keep track of the cat^ory of instruction to which your 
current decisions pertain by typing out headings as you progress through the logic 
tree. It also types out phrases that remmd you of the specific item you are consider- 
ing at the time. For example, if you are determimng who or what will control pacing 
in a variably paced course, the computer will type pacer. These points are illustrated 
in Appendix C, which gives a typical "run" through the program along with an 
example of program output. 

Except in cases with more than two choices for a particular decision (as, for 
instance, with the pacer), typing imeans "yes" and typing 0means "no." If you type 
an ill^ value (i.e, one that is not included in the statement you are reading), in 
most cases you will be in trouble because limitations on computer storage space do 
not allow the programmer to build in automatic checks on each statement. There- 
fore, it is advisable to check each value you type with the list of 1^ values giv«i 
in thestatem^t. 

In the finished wrsion of the program, if an error occurs, you will be able to 
return to the point where the ne^^st heading (or subheading) appeara and repeat 
the decisions in that section to remedy your errot. (This capability has not yet been 
bmlt into the program.) The alternative, to insert the correct value where the error 
occurs, could be chosen if you know the name of the variable associated with the 
phrase just typed out For example, if the value entered for pacer is illegal and 
decisions are being made for average students and Type I instruction, you could hit 
the carriage return and type ''Set CX14)= 1," of whatever your choice loight be. This 
tactic is not advisable for the general user, however, because it requires detailed 
knowledge of the program to be done successfully. 

The capability for buil<Ong in automatic checks for ill^al values depends on the 
langu^e used and the storis^e capacity of the computer's compiler." With Interactive 
FORTRAN and a large enou^ compiler, this capability may eventually be provided. 

At certain points in the program, the computer will type out a phrase or set of 
phrases to remind you of a particular set of sbrat^ decisions that you made previ- 
ously and that you may wish to apply to the nart set of decisions. The program then 
asks whether or not you want t» make such an application by typing policy change. 
If 0 is th«i typed, the set of dedsibiis will automatically be applied to the next set, 
which you then skip. If l is typed, you will be ask^ to make the next set of dedsions. 

You are now ready to spe<%-your jnstruc^o^ straff. 

Adaptivity 

2. In the Questionnaire for Stating General Policy you decided to adapt course 
content to the studente' prior learning that applies to your specific course. You 
planned eithe»- to allow better prepared students to skip material th^ akeady know 
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or to provide more poorly prepared students with some remedial work on course 
prerequisities or both. 

Now you will decide how to determine which students should receive specialized 
treatment. Several approaches may be used. 

• Method L Assume that students have certain strengths and weaknesses 
based on what is known about their background; for example, their scores 
on relevant sections of the Airman's Qualifying Examination (AQE), their 
prior Air Force experience, or their similarity to prior student populations 
in similar courses. This tactic has.the advanta^ of low cost and little 
efiort, but may lead to gross errors in assignment. 

• Method 2. Gather information on the basis of student performance as the 
course progresses. This would provide more infonnation than method 1, 
but it may waste resources in teaching, some students what they already 
know and in identifying students whose preparation is deficient after they 
have gotten weil into the course. Kthis tactic is selected, you .will need to 
identify the.ppintat wUch this. dedsiqn will be made. 

• Method 3. Give each student a diagnostic pretest to pinpoint his specific 
strengths and w^dmesses and to allow him, his counselor, or lus instructor 
to juc^ how much effort will be required to attain various objectives and 
to iect and sequence the materials needed. For accuracy, this is probably 
the best tactic, but reliable and valid diagnostic pretests may not be availa* 
ble. 

If you select method 1, type 1; if method 2, type 2; if inetiiod 3, type 3. 

3. In filling out the Questionnaire for Stetmg General you decided to 
specify different teaching strat^es for students of different learning capabilities 
but not to form special tracks. For some teaching situations, however, you might 
wish to aK>ly the same strat^gjr to all students, regardless of capsd)ility, to foster an 
esprit de/orps even when students are working on individual sto^ For example, 
having aU students work together in a ^hop or llib coSd simulate the actual working 
conditions they are bdng trmned for more 

If strat^es are tailored to student^ learning capabilities for only parts of the 
course, type 1; if for all of the course, fype 2. 

4a. In the Questionnaire for Staticig Genersd PoIicy^ you decided to specify 
different teaching sbrat^es fen* stiidcnite of dpereiit learning capabilities by putting 
poorer students in a separate track: To; aasist slower learners, sometimes a qpedally 
trained instractor is used, such as a rernedM r^^ specialist A special instructor 
will be responsibly for dcogpoing his class. 

If spedal instructors will be ifisign^ to tiic^ slow group, type 1; if r^ular staff, 
typeO. ' 

4b. In the Questiormaire for Stating Gehk«^ decided to specify 

different t^h^; strategies for 8^ 

better studente in a separate tr^cE Spedal in^^ t^(k9e.idtii a stroi^ 

inteUedaial orientation, m^ stimiilkto bi^^ - 

tors may even-guide thieir student^ in designing thar own courses of study. 
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If special instructors will be assigned for the bright group, type 1; if regular 
staS; typeO. 

5. In the Questionnaire for Stating General Policy, you decided to provide 
additional instructional resources for. slower students either by giving them 
remedial work or by allowing them tb repeat sections of the course that they failed. 
Remedial work can complicate scheduling by putting varying burdens on instruc- 
tional resources. If students are sufiSciently mature, however, remedial work can be 
carried out in unscheduled study without involving instructors. Allowing students 
to repeat failed sections is a less efficient tactic but may be simpler to implement 

If remedial work will be provided, type 1; if students will be allowed to repeat 
sections of the course, type 2; if both tactics will be used, type 3. 

6. * If remedial work will be carried out in scheduled sessions outside of regular 
class hoiirs, type 1; if remedial assignments will be made for unscheduled study, type 
2. 

7a.t This preliminary.prpgram will provide only two choices tor the scheduled 
presentation of remedial exercises md iMterials—either the strata will be the 
same as that you select.for scheduled iMpa instruction or an instructor will be 
responsible for remedial sesdons. If you decide (later) to schedule no basic instruc- 
tion, the design program wiU automati(»Uy assign an instructor for conducting 
remedial sessionSy^whichever choice is made here. 

If an instructor will conduct remedial sessions, type 1; if the same strata will 
be applied as tbat'fqHirasic instruction^ type 0. 

T^ype the time thatXthe average studaht will require for scheduled remedial 
s^ons as a percentag^V the time required for the basic instructioh for which 
students will n^d remediation. For example, if the topic treated in a 6-hour session 
is particularly difficulCimrer students may need a 1 % hour remedial session, which 
would add 25 percent to the time reqmred for the basic instruction. 

Tb^: This preliminary pn^sp^m ^ provide the same strata for remedial 
exercises and materials for unscheduled study as that you select for other assign- 
p ments for unscheduled study. If you later decide to exclude unscheduled study in a 
major part of the course, you wfll return .to 7a- 

Variable Pacing J 

8. Although you do not want to adapt teaching methods to the needs of in* 
dividual students, as decided in the Questionnaire for Stating deheral Policy, you 
can sftiU pace tte p^ content to match students' learnmg rates. 

Variable pacing idiows consider;a)le a^jtikment to student needs because, in effect, 
it allows the fast student to sSdm materials he is already fam^ with and gives the 
>^8low stodent tjjhe. to mi^ oyer whathe ne(^ to. 

\Variable padng^.c^ even witiiin a fixed schedule by using 

* ^0 uiswered only tht answer to rtatement 5 u 1 or 3. 
^Tp be anaw^ oa^y ^ 
'-WJ^ To be anaw^red dhly if the anmr to atal^ni^t 6 ^ Z 
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remedial sessions fbr slow students and giving free time to bright students. Since the 
intent of using variable pacing as an instructional strata is to match the rate of 
the instruction to the student's learning rate, some means is required for checking 
student mastery of the material as he goes along. Therefore, an automatic conse- 
quence of choosing variable pacing is that stimuli for overt student response must 
be int^rated into the presentation of material; that is, the materials must be 
"programmed" so that the "pacer" (instructor, adaptive program, or the student 
himself) will have a basis for pacing. Writing materials for variable pacing is much 
more demanding and costly than writing materials for straight presentation. 

Indicate at this point whether you want the entire course variably paced by 
typing 1, whether you want some parts variably paced by typing 2, or whether you 
want nothing variably paced by typing 0. 

9a. In some situations, students are so highly motivated to complete their 
studies that they do not need additional incentives to keep up their learning rate 
in a variably paced course. Since you chose in the Questionnaire for Stating General 
Policy to have the overall course schedule be fixed, however, students may not care 
whether they finish a lesson or series of lessons quickly. If this is true, students may 
need additional incentives to put their best efforts into their work. 

If additional rewards will be needed for motivation, type 1; if not, type 0. 

9b. Because you chose in the Questionnaire for Stating General Policy to have 
the overall course schedule be variable, students may be highly motivated to com- 
plete their studies quickly so that they may go on to more challenging work or to 
other pursuits. If the school environment is relatively pleasant, however, they may 
even have reason to dally. In this case, students may need additional incentives to 
put their best efforts into their work, or a monitor may be used to oversee student 
work during study periods. 

If additional incentives will be provided for motivation, type 1; if not, type 0. 

10. Rewards may consist of material objects, bestowal of status (symbolic or 
real), or additional free time. If free tinie is given as a reward, there may be little 
saving in the amount of time a student requires to complete the work, although the 
time devoted to scheduled instruction may decrease, with a resultant saving in the 
time put in by instructors, monitors, and so on. 

If rewards will include additional free time, type 1; if not, type 0. 

* Types of Instructton 

11. Now you will be asked to identify the m^or types of instruction that you 
will need. (Refer to the definitions below.) 

Type Ilnstruction. Instnictibii.tM requires no student use of special equip- 
ment and no student performance in special facilities, hi addition, students are not 
acquiring skills (cQgmtive, psychomotor, nidtor; or social) tluxiugh drill or practice. 
Type I activities typically occur in the classroom and concern the presentation of 
fects or concepts for the stodent to mfert»r or t^^^^ of goals or objectiveB 

to motivate him with a sense of direction fof^his lear^^ J^iiently includes 
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affective objectives (such as changes in attitude toward the subject) and demonstra* 
tions. Most Type I instruction involves presentations, and may or may not contain 
integrated stimuli that require overt student responses. 

Type n Instruction. Like Type I instruction requiring no special facilities or 
equipment for student performance; however, students master skills that require 
drill, practice, or performance. The student learns to make particular responses 
when provided with directions and stimuli. Activities are those in which the student 
must do something besides answer questions. Also includes the presentation of 
models of skills to be mastered (even though no student performance may be re- 
quired during the demonstration) becaiise demonstrations are frequently givef ini; 
mediately preceding student performance. Therefore, it may often be convenient t^ 
\ use the same means to present the .models as those used to present directions for 

performance or actual drill stimuli. If a performance model is to be given &it^not 
immediately preceding or concurrent with the drill, practice, or performance ses- 
I sion, it may be categorized as a segment of Type I instruction. 

\ Type n instruction can include pure skill demonstrations (withino;student re- 

sponse); follow-me demonstrations (or step-by-step directions) in which the students 
I perform each step as they are directed or as each step is presented; presentation of 

directions and stimuli for performance; and pure performance (with no presentation 
{ to the student): The distinction between the latter two categories is implicit in the 

\ Curriculum Analysis which estimates the time required for presentation. 

Type in Instructioii. Any instructional activity that requires the students to 
i work with special equipment (such as a simulator, a piece of machinery, or a musical 

^ instrument) or in a special fitcility (such as a shop, a laboratory, a parade ground, 

I or other special area) or both. The instructor is /lo/using Type HI instruction when 

^ he uses special equipment (such as a projector or mockup) to demonstrate a proced- 

I ure or to clarify a concept (such as operating aircraft flight controls) unless the 

I students are also required to use the same equipment at the same time (or immedi- 

I ately afterward). The rules for classifying performance models and presentations for 

Type in instruction are the same as ihose for T^pe 11 instruction, namely, if the 
model immediately precedes or is concurrent with the student performance, it is 
raost conveniently treated as Ty^ m instruction; if the model will be separated in 
time from the student performance, it may be treated as Type I instruction. 

If Type I instruction will be used, type 1; otherwise, type 0. Use the same code 
for Type n and Type HI instruction. 

Instructional policy is now set for each type of instruction that appears in the 
course. This policy vidll cover all aspects of the course, including assignments for 
independent study that will be preplaxmed and prepared ahead of time. 

j 
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ALL TYPES I AND H INSTRUCTION 



Formal Ezaminations 

15. Now you will set a general policy for the frequency and content of formal 
examinations. (The program excludes any examination activity that does not re- 
quire time during the teaching day, such as grading papers at home. The instruc- 
tional time required for checking a homework assignment is treated as part of the 
policy for unscheduled study or homework,) 

If students are not required to master course content on a fixed schedule, it is 
impossible to schedule examinations covering a given set of topics for fixed time 
intervals. Therefore, statement 15a will be read if a fixed schedule will nothe used; 
otherwise, statement 15b will be read. These set the stage for statements 16 through 
20. 

15a. The best basis Tor establishing an examination schedule to check student 
progress is the course content itself. As ilsed here, topic means a imit cf content. 
Several related topics may be grouped together into a nMgor section (block) of the 
course. 

15b. Either of two bases can be used to set the examination schedule. If you 
want the exam schedules to be based on the natural groupings of the course content 
itself, type 1; if they are to be based on fixed time intervals, type 0. 

16a. Next, decide on the frequency of examinations. You may choose as many 
as you wish of the examination frequencies listed by the computer (including all of 
them). If you want formal examinations to be given daily, type 1; otherwise, type 0. 
Use the same code for examinations given weekly, after each miyor course section 
(such as at midterm), and at the end of the course. 

16b. Next, decide on the frequenpy of examinations. You may choose as many 
as you wish of the examination fr^uencies listed by the computer (including all of 
them). If you want to examine student progress after each topic, type 1; otherwise, 
type 0. Use the same code for examination after each m^'or course section and at 
the end of the course. 

17. T^pe the approximate niunber of minutes to be set aside for each kind of 
examination as it is displayed. 

18. Examin ations can test student mastery of only the material covered since 
the last e xamin a t ion or can test material covered in previous examinations. Al- 
though retention is ehcoiuraged by including materials from previous examinations, 
d^lngWcw make the te^^^ or can force the examiner fo slight the objectives 

that students should have attaintf^ ainfift thft-pmyinnfl A TflThihflf inn 

VlSar^If the exiwiination after eacfii topic will test only that topic, type 1; if it 
will'test that topic and some preceding topics in the same rn^or section, type 2; if 
it will test that topic ^md some pi^^ type 3. 

19b. If the examination ^;er each n^ Will^test only that section, 

typed; if it will tesjk t^t section sections, type 2, 

19c. If the endK>fHX)urse eiuuninatio^ will test stiudent mastery of only the last 
m^or section, type 1; if it Will test stiid^t mai^iy of t^^ course, type 2. 

.96 < 



ERLC 




20a, If the examination after each day will test only that day's work, type 1; 
if it will test that day*s work and some preceding work during the week, type 2; if 
it will test that day's work and some preceding work in the same mcyor section, type 
3; if it will test that day's work and some preceding course work, type 4. 

20b. If the examination after each week will test only that week's work, type 
1; if it will test that week's work and some preceding work in the same m^jor section, 
type 2; if it will test that week's work and some preceding course work, type 3. 

20c. If the examination at the end of a mcgor section will test only that section, 
type 1; if it will test that section and previous sections, type 2. 

20d. If the end-of-course examination will test student mastery of materials 
only in the last section, type 1; if it will test student mastery of the entire course, 
type 2. 

21. Usually a proctor is provided during quizzes and exams to assure against 
obvious cheating. Designate the level of the proctor for each type of examination 
displayed by the computer by typing 1 for instructor; 2 for instructor's aide, student 
instructor, or clerk; 3 for student leader; or 0 for no proctor. 

22. If many students will take the course, time and money can be saved by 
machine scoring of objective tests. Machine scoring also abets statistical analysis of 
test results, item analysis, and so forth. If only a few students will take the course, 
however, machine scoring can be overly expensive, even though it is assumed to take 
essenufiUy no tune. Consider primarily whether you need the additional data*proc- 
essing capability when you niake this decision. 

!f objective tests will be machine scored, type 1; otherwise, type 0. 

23. * Perhaps you will want to allot schedided time to the instructor (part of his 
work day) for scoring examinations. If so, the design program will allot 30 seconds 
per student for.scoring per 60 minutes of objective examination (if not scored by 
machine) and 10 minutes per student per 60 minutes or examination calling for 
essay-type answers. For example, if an objective test for a class of 20 students takes 
50 minutes, the instructor will be allowed 20 x % x 50/CO = 8% minutes for scoring 
it. If an essay test for the same students takes 50 minutes, the instructor will be 
aUowed 20 x 10 x 60/60 = 167 minutes (a. 2% hours) for scoring it. 

Alternatively, the instructor may do this chore aft;er school. If you plan to allot 
part of the work day for scoring examinations, type 1; if not, type 0. 

Planned Review 

The computer directs you to these statements on the basis of your formal exami- 
nation decisions. For example, if you.decide to have ah examination at the end of 
each topic and have answered questions 2 to 30, then you will be asked to read 
statement 3la. " ' 

30, Now review policy for Types I and n instruction must be established. 
Reviews may be cauiied out in. scheduled lessons or unscheduled study and may 

* Even if statement 22 is answered 1, statement 23 must be answered because some of the ezamina* 
tions may not be objective tests. '-"^^ ^^^^ 
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consist of simply going over basic instruction or of using material especially pre- 
pared for review. If it will be sufficient simply to suggest that students review the 
materials that will be subject to test, type 0, and the program will require no further 
decisions about review. If scheduled or unscheduled time will be allotted for review 
before each formal examination, type 1, and the program will skip statement 31. If 
time is to be allotted for reviews before only some of the examinations, type 2. 

31a. If you want to allot time for review before the examination at the end of 
each topic, type 1; if not, type 0. 

31b. ' If you want to allot time for review before the examination at the end of 
each day, type 1; if not, type 0. 

31c. If you want to allot time for review before the examination at the end of 
each week, type 1; if not, type 0. 

31d. If you want to allot time for feview before the examination at the end of 
each megor section, ^rpe 1; if not, type 0. 

31e. If you want to^allot time for review before the final examination, type 1; 
if jiot, type 0. 

32. If the review will be conducted at a scheduled time and under the supervi- 
sion of an instructor or monitor, type 1; if the student will do reviewing during 
unscheduled study, type 0. 

33. If special materials will be prepared for this review, type 1; if not, type 0. 

34. Type the number of minutes the average student will require to complete 
this review. 



Scoring Deskwork 

37. You decided that some basic instruction will require students to work with 
materials that record overt student responses but do not provide the answers.* 
Students can learn by scoring their own classroom work after completing it; how- 
ever, this denies the instnictor the opportunity of using the work to diagnose the 
daily progress of each student in detail; If you decide to use class time for students 
to score and discuss their work, scoring sessions will be included in any discussion 
sessions you schedule. This decision will apply to all cases of this kind in either Type 
I or Type U (classroom) instruction. 

If students will score their classroom work in. cla^, type 1; if not, type 0. 

38a*t If many students will take the course . and) the instructor will receive 
information on each student's daily progress, a machiiie can be used to score class- 
room work calling for selected response. Machine scoring also abets statistical analy- 
sis of the reliability of individual items in programmed materials. As mentioned 

• The computer wiU have directed you to tluB dedsion (statement 83) befoi« it directs you here. 
AnsTOM muat be given to the stiul^t in an ihatructional strategy of self-padng (the student must know 
whether he was right or wrong in dider to jpiux^ himselO/selfdii^^ adaptivity or instructional method, 
response-paong (the reaction of the mac^e givM 1^^^ or fWly automted programs (CAD. 

t Statement aSa will be read'if the da«room iMtiiirtioh ca^ scdec^ raeponses and the answer 
to statem^t 22 was MSee statement 81 or tho Glosswy fd^ a discussion of selected response.) If the 
answer to statement 22 was 1» the sinswer to statement 38a will be assumed to be 1. 

Statement 38b will be read if the classroom instruction calls for constructed lesponse. 
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earlier, however, if only a few students will take the course, machine scoring can 
be overly expensive. Finally, the choice of scoring classroom work can be left up to 
the instructor. 

If a machine will be used to score classroom work, type 1; if part of the work 
day will be allotted to the instructor to hand-score classroom work, type 2; if scoring 
will be left to the instructor's discretion, type 0. If 2 is typed, the design program 
will allot 30 seconds per student for scoring per 60 minutes of basic instruction. 

38b. The instructor may be allotted scheduled time (part of his work day) for 
scoring student classroom work Alternatively, he may be expected to do this chore 
after school, at hifi discretion. If part of the work day will be allotted for scoring 
student work, type 1; if not, type 0. If you type 1, the design program will allot 10 
minutes per student for scoring 60 minutes of basic instruction. 



Question and Discussion Sessions 

40. The choices you made to this point concerning presentation of material 
may result in relatively long sessions during which the student is learning essen- 
tially on his own. If the material is relatively simple, the most efficient tactic may 

^ be to let the student save whatever questions occur to him during the session for 
later discussion with his instructor (during a special discussion session) or his fellow 
students. This procedure is commonly used to review and discuss film presentationr. 
and the like. Alternatively, a monitor or full-fledged instructor may be on call during 
the initial presentation to answer questions as they arise. If the material is rela- 
tively complex, this may be the best choice. 

If you want to allow time for a special discussion session with the instructor, 
type 1; if a monitor or an instructor indll answer questions during the presentation, 
type 2; if the student can solve his pr^^blems by talking with fellow students on his 
own time, type 3. 

41. If you expect to set formal instructional time aside for these special discus- 
sion sessions, type 1; if the sessions will be conducted outside of r^^ular ii^ructional 
hours, type 2. 

42. Type the percentage of the time the student spends working on his own that 
should subsequently be devoted to discussion sessions. 

43. Discussion sessions may be scheduled in several wa^: they may be con- 
ducted at the same time every week» biweekly^ or as often as necessary to take cm-e 
of student needs. If discussion sessions are to be scheduled^ the design program will 
schedule sasNsions at the same time each week or.more often if necessary, based on 
a minimum length of 15 minutes per session. 

Discussions may be conducted whenever 15 minutes worth of discussion time 
has accumidatedi or they may be conducted immediately following difficult topicSi 
if at least 15 minutes worth has accnunulated 

If sessions will be scheduled at regular intervals, type 1; if they will be scheduled 
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whenever 16 minutes worth of discussion has accumulated,' type 2; if they will be 
given following difficultf topics, type 3. 

44. If you want the instructor to be present for these discussions, type 1; if he 
may be at a distant location but accessible via a communication medium (such as 
in a studio for closed-circuit TV— students would have talk-back capability), type 0. 

45. Several procedures may be used to enable an instructor or monitor to 
answer questions during a presentation. He may physically be present where the 
students are receiving the presentation or he may be at a distant location but 
accessible via a communication medium. In the latter case, accessibility ma be 
continuous or it msy be provided at preplanned points during the presentat i. 

If you want the instructor or monitor to be physically present for anr ^?ring 
student questions during the presentation, type 1; if he may be at a distant location 
but accessible via a communication medium, type 0. 

46. . If accessibility should be continuous, type 1; if not, type 0. 



TYPE I INSTRUCTION 
Test Responses 

47a. Objective teste, which caU for selected responses, are generaUydiffic^^ 
write well, especially for diagnosing complex behavior. For example, it may require 
45 minutes to write a good multiple^hoice itom. But objective tests are easy to 
administer and score, whereas teste calling for constructed responses take longer to 
administer, are often difficult to score objectively, and can require the grader to 
invest large amounte of time in reading and judging the students' work. Therefoi^, 
if the test will eventually be administered to many studente, the time required to 
write an objective test may be well worth the investment If only a few studente will 
take the test before the course content is changed significantly, and if objectivity of 
scoring is not a serious problem, teste calling for constructed reeponses may be the 
better choice because they are easier to write. 

47b. Because IVpe I instruction requires Uttle driU or practi 
always possible to examine student mastery using objective teste. Three options are 
open. If student mastery of all materials (easy or difficult) will be examined by teste 
caUijig for selected responses, type 1; if selected rinses wiU be used only for 
relatively eaqr materials, type 2; if there are to be no questions calling for selected 
responses for formal examination, type 0. 

48. Usually fonnal examinations are presented on printed pages, which may 
contain diagrams or pictures. In some cases, however, as in recp^piizing sounds or 
move£Qent, :it may not be .pd^ to examine student mastery by means of the 
printed page. Such a case may require the same mews of preeentetion as used in 

* TOe deito program idll kyp tradk of >cciimul«ted diicaiMkm tune, 
t As Mentifiad in the (Ximculum AiuJ^nnii. 
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the original basic instruction. If you want to use printed pag^ for review and 
examination of all of Type I instruction (substituting verbal descriptions or pictures 
where needed), type 1; if you want to use the same means you used in lu^ original 
instruction for presenting e^uiminations and reviews, type 0. If you type 0» and the 
instructor presented the learning event to be escamined, the logical result would be 
for him to give the examination in person. (The Curriculum Analysis wiUl have 
identified a media class appropriate for that learning event) If a media system that 
could have been used for the learning event is obtained for other parts of the aiurse, 
that media system will also be used for the examination. 

If the presenter was an adaptive program or a response-paced progrsmi a 
' branching or response-paced test will be used. 

Unscheduled Study (Homework) 

50. Unscheduled study is defined as study by individual students or grou])e of 
students outside of normal class or lab periods and at times of their own choocting. 
This implies that no instructor or monitor ia present, although special facilities \my 
be needed such as libraries, learning centers, or study carrels. Students worldog 
individually with self-paced materials in a normal class period and under the a:Iie* 
duled super v ision of a monitor are not engaged in unscheduled study. Unschedu led 
study levied no requirements on the instructional system for the scheduled preseiace 
oi'a trained or semitniined iitstructor nor for the scheduled use of facilities such as 
clacerooms, workshops, or laboratories for the study of a specific body of material. 
These facilities may have to be made available, however, to meet student noeds 
when they are not receiving regularly scheduled instruction. 

If you will include unscheduled study in your course, type 1; if not, type 0. 

51. Several means nmy be used to present information for unscheduled sliudy. 
Students can work with books or workbooks or can view presentations by film, ^/ideo 
tape, and the like. All media that can cany the ftill burden of information to be 
piesented are termed conununication media. Most such media normally present a 
given body of information within a fixed (invariant) period. We term anytiiine; tiiat 
runs essentially without interruption and without changing pace or content a fixidd- 
duration program. Piresentation may also be accomplished by a responseipaced 
program, a device that calls for overt student response, senses the response^ and 
waits for the correct responses before proceeding with the presentation. An aditpti ve 
program not only accepts and acts on student responses but'provides problems of 
varying levels of difficulty based on student responses* 

If you want presentations of T^pe I instruction for unscheduled study to be tqr 
a communication medium^ type 2; if by an adaptive program} type 4; if by a fixiid- 
duration program, type 5; if by a response-paced program^ type 7. 

52. If you want stimuli for overt student response integrated into the presenila- 
tion, type 1; if not, type 0. 

^ .53. If correct responses will be provided along with the presentation of stimuli* 
type 1; if not, type 0. 
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54* When a student is studying jjsdependently and without any partioilar time 
constraint, he can often make most efficient use of his time if he can spend more of 
it on sections that give him trouble, skip sections that are easy, or return to sections 
that he is not quite sure of Without the addition of special devices, only the printed 
page provides this kind of freedom for self-direction, which we term intdmal random 
access* Controls such as fast forward can be added to fixedniuration programs, and 
other devices are being developed to make response*paced and adaptive programs 
flexible in this way* If you want the student to have internal random access for 
unscheduled study, type 1; if not, type 0* 

55* You may want to use some means of checking whether the students have 
actually carried out their assigmnents for unsdieduled study* Work mi^ be collected 
and graded outside of class, which takes n^ligible time from scheduled instruction, 
some instructional time may be devoted to checking the work or giving a quiz, or 
the work may be discussed in daiis or with the individual student to clear up points 
of confusion* Probably the most effective tactic is to check the work or give a quiz, 
Ibid then to discuss it with the students, but this is also the most time^onsuming 
choice* Simply going over the work in class or with individual students without 
grading or otherwise checking it may encourage the la:^ student to slight assign- 
ments because he believes he can lely on the discussion to learn the material* The 
most efficient strategy is to collect the work, grade it outside of scheduled instruc- 
tional time, and discuss it in class or with individual students during the following 
scheduled sesmon, but this puts the heaviest demands on the instructor* 

If there will be checks, gradefi, discussions or qumes on assignments for un- 
scheduled study, type 1; if not, type 0* 

56* If scheduled instructional time will be devoted to diffcussing or checking 
assignments for unscheduled rtudy, type 1; if not, type 0* 

57* How many scheiMed minutes per session will be devoted to discussing or 
checking homework assiffiments, on the average? 

Difficulty 

59* In IVpe I iist^ uction some topics are more difficult than others, deiiending 
on the students' familiarity with the material and their general ability to learn the 
given subject At this point if you designate two levels of difficulty for topics in Tyr^ 
I instruction, then two strategies can be set for Type I instruction— one for each 
level In the Curriculum Analysis, topics are identified as ea^y or difficult If a 
strata will be set for only one difficulty level, type 1 for only one of the difficulty 
levels* If relatively easy topics wiU be taught type 1; otherwi^ 
code for relatively difiBcult topics* 
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TYPE I INSTRUCTION FOR RELATIVELY EASY AND RELATIVELY 
DiFnCULT TOPICS 

This section contains two sets of decision points^ each of which pertains to 
relatively easy or relatively difficult Type I instruction. For conciseness, the steps 
are presented in parallel. For example, statement 60a pertains to relatWely easy 
material, and statement 60b pertains to relatively difficult material. While making 
decisions on relatively easy Type I instruction, the computer will direct you to 
statements peitaining to that category; similarly, for relatively difficult Type I 
instruction. 

Specifying Strategies for Differ<mt Student CapabiUties 

You will be directed to this section only if yon chose in the Statement of General 
Poliqr to specify different instructional strategies for different student learmng 
capabilities for all or parts of the course. If not, you will proceed to statement 70 
(variable pacing) or statement 77 (presentation). 

60a- Specifying instructional strategies on relatively easy or simple topics for 
different student learning capabilities may involve Uttie beyond deciding whether 
the brighter students can pick the information up firom media and whether the 
slower ones may need help from the instructor. 

If you want to adapt instruction of relatively easy topics to student learning 
capabilities, type 1; if not, type 0. 

60b. In adapting instruction o^ relatively difficult topics to student lear^iing 
capabilities, it may be necessary to establish sequences of related objectives 
hierarchies of objectives* Each student's initial knowledge of pomts or steps in thi» 
sequence will probably be somewhat different from another's- Moreover, the se- 
quence appropriate for one student may be different from that appropriate for 
another. It is likely that good dedsioi^s about such matters require a high degiee of 
skiU. 

If instruction on relatively diflkult topics will be adapted to student learning 
capabilities, type 1; if not, type 0. 

61a«^ Now the adapter d'the instructional method must be chosen. Such adap- 
tation may be made during instruction (concurrent) or between sessions of instiuc* 
tion (between-session) or both* 

Instractor* 

Considerations: For immature students; it is probably wisest to rely on the 
instructor to prepare in advance a daily or weekly scft of study activities for each 
student In some cases, however, curricula or adaptive programs have been designed 
that can assume this chore with minimal guidance from the instructor. If students 
are suffidently mature, tb^ may be abje to deilig^ 

instructor may be the only agent competent enough to perform this task well, 
* TobesiiiwsredafUrfltataiiiaots66aiideS. 
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however; this puts a heavy burden on him and may increase the system cost, and 
he may be impatient or unreliable (that is, he may react to student characteristics 
that are irrelevant to learning). 

Logical Qmtequencet: Choosing the instructor as the adapter does not limit 
your further decisions. That is, you may still choose the presenter of instruction and 
the way in which students will interact with the instruction. In effect, you may, by 
choosing the instructor as the adapter, design a qrstern with both between-session 
omf concurrent adaptivity. 

Adaptive Program. 

Considerations: Adaptive programs are expensive to prepare, although if 
many students will eventually use them, their cost may be spread thinly enou^ that 
they cost about the same as instructors. If appropriate adaptive programs are al* 
ready available, the preparation cost may not be a stumbling blocL Adaptive pro- 
grams are usually presented by a computer, which ftirther increases cost; however, 
adaptive programs may be prepared by highly qualified teachers within the subject 
area and can be more diverse in their adaptivity and more reliable than an avenge 
instructor. Furthermore, they never lose patience with the slow st'idtmt nor ate tiney 
threatened by the brifl^t one. 

Logical Consequences: An saiaptive program manages the presentaticm of 
materlul. It will prer^ant stimuli for overt studsht response along with the presenta- 
tion of information, **sense" etnt^v&U* responses for pacing and branching, and select 
the next set of objectives to mastered. By the action of the machine, the student 
will automaticaUy be given information about whether his responses are correct or 
incorrect Because a madiine manages the instruction, student responses must be 
selected. 

61b.* Student Le«4er. 

, Considerations: Even though a high degree ofoompetence is required to adapt 
tMching method to the needs of individual students, mature and responsible student 
leaders may be oble.to perform this task because fbey, in effect, speak the language 

^-o^tiwir peers. In addition, they are less expensive than instructors or adaptive 
programs. There may be peripheral benefits, as well, to using i!tudent leaders in this 
way. By teaching the subject matter, thej- may undentand it better and retain it 
longer. Tlwy msy also develop communication and other <iodal skills and encourage 
tiie development; of such skills l^theirpeerr FinaUy, their own sense of reeponsibU- 
ity toward and interest in learning may be imi»oved 

Student leo^rs may, however, exhibit some of the same defects as an instruc- 
tor, viz., imrelial)ility (reaction to irrelevant student characteristics), impatienoe, 
fear of being shown up, .or lad( of imagination in a(^mmodating to student differ- 
ences. 

Logical doruquences: It is unreasonable to expect a student leader to prepare 
the materials and aids he would need to adapt teabh^ method to student capabil- 

* Tblwi««loalyifoniiMooataotmui»(>oibepnMntodw 



104 



ity. Therefore, he must be provided with such materials. In addition, these materials 
should be programmed; that is, stimuli for overt student response must be inte- 
grated with the presentation so that the student leader can determine whether his 
efforts are successful. This also means that he will require models of correct re- 
sponses in order to check student progress. (The students themselves may or may 
not be given these models during the instruction.) The student leader will be a 
concurrent adapter. Whether he is also a between-session adapter will depend on 
your answer to statement 62. 

Individual Student 

Considerations: Assigning the role of adapter to each individual student pre- 
supposes that each has a relatively high d^^ of academic maturity. Althou^^ 
some students may have this maturity, it is tmlikely that all of them do. In addition* 
making each student his own master does not encourage the development of social 
skills to the extent that use of student leaders does, although it may foster stronger 
attitudes of responsibility. 

Logical Consequences: These are the same as for the choice of a student lea^ 
with one exceptibn, viz., the stud^ts themselves must receive models of correct 
responses in order to direct their own prpgreas. 

61c. Adapting I instruciion on relatively easy topics to student learning 
capabilities may simply require a decision about how much reliance to place on the 
instructor for presentation and explanation. 

61d. Before T^pe I instruction on relatively difficult topics can be adapted to 
student learning capabiliti^ a careM analysis of the concepts or principles bdng 
taught may be required. Discovering how to perform this analysis and to tailor it 
to the needs of different learners may be very demanding. If instructors are gkillfiil, 
you may expect them to perform these tados. If not, well*made teaching materials 
may be needed . In more straightforward areas such as mathematics or reading, some 
adaptive programs have been- worked out to acconunodate differences in student 
learning abilities. 

61e.* If you want the instructor to choose the materials and methods appropri- 
ate for each student or group of students, type 1; if an adaptive program, type % if 
each student, type 3; if a student leader, type 4; 

61f * If you want the ihstructorto choose the materials and methods appropri-, 
ate for each student or^up cf sltMents^^f^ type 2. 

62. The instructor, the individual stud^t^ or the student leader may choose 
from among materials (medk pfqg^^ re^rehce books, lesson guides, etc.) pre- 
pared in units adapted to successive levels of difficulty to present tte subject matter 
and to provide knowledge of sti^csit progress; Such s&atified materials may be more 
carefully tailored to antidpated student ne^ but *hey are more expensive than 
a gener^ presentetiqn. Students who are rdativdy more adept at independent 
study can make better U£n^ of a c^nei^^ presehtetion than less independent stadenta 

If you wantvto pr^ type 2; if a 

general pres^tetion iidU suffi^ 1^ 1* 

* WmberaadifaiWs^utehMiiqtbmd^^ 
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Grouping 



This section is entered only if witiiin-class grouping is used for the pertinent 
cat^ory of instruction such as relatively easy Type I instruction. Statement 65 must 
be answered if tracking is notuaed (tracking puts students into invariant groups for 
all types of instruction). Statement 66 then reminds the user of the ability level of 
tiie students that his immediate decisions pertain to. The user then returns to 
statement 61. 

65a. For instruction on relatively easy or simple topics, how would you like 
your students grouped? (Refer to your analysis of student population to be performed 
in step 1 of MODIA.) If into two cat^ories (slow and average-to-bright), type 1; if 
into three eateries (slow, average, and bri0it), type 2; if into two cat^ories (bright 
and slow-to-averageX type 3; if each student is treated on an individual basis, type 
4. 

65b. For instruction in relatively difficult or complex topics, how would you 
like to group students? (Refer to your analysis of student population.) If into two 
eateries (slow and average^o^r^t), type 1 ; if into three eateries (slow, average, 
and bri^t), type 2; if into two eateries (bri^t and slow-to-average), type 3; if each 
student will be treated on an individual basis, type 4. 

66a. Now determine instructional strategy for the slow group. Next you will 
determine it for the average4o4>right group before proceeding to the next type of 
instruction. 

66b. Now determine instructional strategy for the slow group. Next you will 
determine it for the bright group, and finally for the average group, before proceedr 
ing to the next type of instruction. 

66c Now determine instructional strategy for the bri^t grou p. Next you will 
determine it for the slow^n^average group before proceeding to tiie next type of 
instruction. 

66d. Nowdetenninestrategy that allows the instruction to be tailored to in- 
dividual needs. Immature students may require considerable help from the instruc- 
toi^ more mature students may work quite independentiy. 

66e. Now determine instructional strategy for the bri^t group. Next you will 
determine it for the average group before proceeding to the next type of instruction. 

66f Now determine instructional strata for the average group before pro- 
ceeding to the next type of instructipn. 

66g. Now determine instructional strata for the slow-to-average group 
before proceeding to the next type of instruction. 

66h. Now determine instructional stratc^ for the average-tobright group 
before proceeding to the next type of instruction, 

Variable Padng 

The computer will direct you to this section if you chose variable pacing for all 
or parts of the course. If you did hot choose it for a//of the course, you first decide 
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whether it will be used in the part of the course to which your current decisions 
pertain (statement 70). 

70a Some educators believe that there is a greater spread in student ability 
to learn difficult subjects than in their ability to master easy or simple subjects. If 
you hold this view, you might find variable pacing more useful for relatively difficult 
Type I instruction. Variable pacing typically requires more time in preparing 
materials (such as programmed texts), but if many students will use the materials, 
this investment may readily be repaid. Variable pacing may also be accomplished 
by tutoring individual students or by constructing different activities for small 
groups of students. This may be justified when highly personalized instruction is 
needed, such as teaching a performing artist or dealing with a student who has 
severe educational or emotional handicaps. 

70b. If you want to use variable pacing for relatively easy Type I instruction, 
type 1; if not, type 0. 

70c. If you want to use variable pacing for relatively difficult Type I instruc- 
tion, type 1; if not, type 0. 

71a. Next, you must choose the controller to pace the instruction. Some of the 
consideraticnis surrounding and logical consequences of the various choices are 
discussed below.- 

Individual Student 

Considerations: Assigning the individual student as pacer builds study skills, 
frees the fast learner to direct his attention to particularly difficult or interesting 
topics, and allows the slow learner to take his time without fear of embarrassment. 
If students are immature or insufficiently motivated, however, they may take advan- 
tage of the situation to dally. 

Logical Consequences: If the individual student controls pacing, he must be 
supplied with programmed materials, and these must provide him with the correct 
responses to enable him to pace himself. He will, of coiurse, progress at his own rate, 
not at the average rate of a group. 

Bistructor. 

Considerations: An instructor can speed up the learning of students whose 
motivations are deficient and can immediately spot points at which students are 
having difficulty. Instructors are expensive, however, especially when used as tutors 
or leaders of very small groups of students, and some instructors may become 
impatient with slow learnera. 

Logical Consequences: If the instructor controls pacing, he must also present 
the basic instnictibn. 

Studeiit Leader of a SmaU Group. 

Considerations: Assi^^ing a studeiit leader as pacer builds study skills, com- 
munication skillB, and other social skilis. It may also promote longer retention of the 
material learned; at least by the student leader, and overcome the effects of poor 
motivation among the other students. Student leaders are less expensive pacers 
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than instructors and have some of the same desirable attributes. They may also be 
more patient with and understanding of their peers. Mature students who are 
interested in the instruction should be chosen as student leaders. 

Logical Consequences: A student leader must be supplied with programmed 
materials to work from, and these materials must provide him with the correct 
responses so that he will know how to pace the group. (He does not have to transmit 
the correct responses to the group, however.) 

Response-Paced Program* 

Considerations: Response-paced programs (usually presented by teaching ma- 
chines) are the most objective and reliable of all pacers. They cannot become impa- 
tient, and will not proceed imtil the student has made the correct response. The 
student cannot skip idly through the program but must interact with it frame by 
frame. A response-paced program cannot entirely overcome the effects of poor moti- 
vation, however, because the student can still dally in answering or can answer at 
random until he hits the zight^response. The hardwEu^ cost for presenting response* 
paced programs is usually not a domdu^ 

A linear.progranunedtert isnotaresik^ 
controls his own pace when working with a programmed text. Progranmied texts 
can call for either selected* or constructed responses. 

Logical Consequences: If a response-paced program is the pacer, the instruc- 
tion must be presented by whatever communication medium is appropriate. Student 
responses must be selected in nature because practical machines have not yet been 
built that can recogioze and determine the corredxiess of natural language or other 
types of constructed responses. It is asstmied thiat the machine's reaction to the 
student's response provides Jiim with sufficient feedback about the correctness or 
incorrectness of his response. 

71b. If the leader of a small group will pace the presentation of information for 
relatively easy Type J instruction, type 1; if the individual student, type 2; if the 
instructor, type 3; if a response-paced program, type 4. 

71c. U*the leader of a small group will pace the presentation of information for 
relatively difficult Type I in^tructi6n, ;type 1; if the individual student, type 2; if the 
instructor, type 3; if a i^ponse^paced program, tyi^ 4. 

72. Pacing may be r^iUated'on the basis of some average rate of response.! If 
students can be grouj)^ rektively homogeneously^ approach can approxi- 
mate th^ benefite of mdividual p£un^ and decrease espense by requiring less prepa- 
ration or fewer instructors. If such groups will W.fpnned, type 1; if not, 0. 

73. . Select the number of leveb of stud^ learning rate to l>e accommodated 
by homogeneous grouping by tiding 2, 3, or 4. 

74. It is often helpM to give an insj^(^r who is controlling the pace of 
learning a programmed guide, supplemented by ihstrii as nec^ssiuy, that 
discusses the basic content to be learn^ and^ con tii^ stimuli for student re- 

* See tHe discumon of aelecteti rei^onae in stat^oient 81. 
t Reiqpbnfle rate is correlated with letraing cai^^ 
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sponse. If you would like the instructor to have a programmed guide, type 1; if not, 
typeO. 



Presentation 

The following set of statements is read for a particular cat^ory of instruction 
only if instructional strata will not be tailored to student learning capabilities and 
there is no variable pacing, or if an instructor will tailor instructional strata to 
student learning capabilities. In all other instances, the presentational means and 
other matters will have already been determined. 

77a. Several means may be used to present information. An instructor or a 
student leader, supplied with needed reference materials, texts, and instructional 
aids, can address one or more students,'answering questions as they arise or when 
the presentation ends. Alternatively, students can work individually with books or 
workbooks, or can view presentations by film, television, and the like. We term all 
media that can cany the full burden of the information to be presented comniunica- 
tion media* That is, a communication medium makes it possible to present a message 
without the message sender (teacher or curriculum designer) being present at the 
point of reception by the learner. 

Most communication media normally present a given body of information 
within a fixed (invariant) period. FUms, television programs, and audio tapes are 
examples. Anything that runs essentially without interruption and without chang- 
ing pace or content in response to outside influences is termed a fixed^uration 
program. Telemedia programs are usually^of fixed duration. 

Fixed-duration programs simplify scheduling. They do not, however, allow an 
individual student to go back over material or to select material at random (as he 
can with books, workbooks, and the like) unless they are recorded media such as film 
or tepe, and are being used in' the individual mode, with the necessary equipment 
so he can control the presentation as he wishes. 

For relatively easy Type I instruction, a student leader could present informa- 
tion as could any appropriate communication medium. Usually when a student acts 
as ah instructor, he will learn more than he would otherwise. You jociight prefer to 
save the best instructors for presenting infbrinatibn for relatively difficult Type I 
instruction. If you choose any appropriate conmmmcatibn m the final choice 
of media system will be made bii the'basis^ criteria. 

77b. Ifyou want the ins^ 
I instruction, type 1; if any appfbpmtecoit^ if astudent 

leader, lype 3; if a fixed'^iuatidn progriun, 5: ^ ' 

77a If you want the instructor to present inforaMrfiOT for relatively difficult 
Type lindfuction, type appropriate opm^ mikiium, type 2; if a 

student leader, tj^ 3;^^^^ 5: 
. 77d.* Because a fix«i schediile muiSt be ir^ it is probably unwise to 
allow a student leader to present inforin^ can 

. * WiU be read if a Iked schedule has been ch^ 
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work with communication media under the instructor's supervision. Therefore, 
presentations should be made by an instructor, by fixed-duration programs, or by 
any appropriate commimication media. 

77e. If you want an instructor to present information in person for relatively 
easy Type I instruction, type 1; if students will work with appropriate communica* 
tion media, type 2; if fixed-duration programs will be used, type 5. 

77f If you want an instructor to present information in person for relatively 
difficult Type I instruction, type 1; if students will work with appropriate communi- 
cation media, type 2; if fixed-duration programs will be used, type 5. 

78a- You chose an instructor to present information. If the instructor is highly 
skilled and has extensive teaching experience, it may be wisest to allow him consid- 
erable latitude in choosing materials and instructional aids for his presentation. 
Alternatively, trained curriculum designers, producers of educational materials, 
designers of training aids, and so on, may be available to prepare the materials and 
aids that the instructor may draw from, ff you want to supply the instructor with 
prepared materials and aids, type 1; if the instructor must gather or generate his 
own materials and aids, type 0. 

78b. Even though you may want the instructor to gather or generate his own 
materials, in some situations it may be relatively expensive or even overly danger* 
ous for him to do so. This may be especiaUy true if special equipment or facilities 
are needed to present the instruction— for example, if the effects of nuclear weapons 
are to be demonstrated. In such cases, it may be necessary or more practical to use 
an appropriate communication medium to present the message. 

If yoi* want to iise a communication medium for presentations requiring special 
facilities or equipment, type 1; if not, type 0. 

79a. Frequently, several relatively simple tasks are taught at once, such as the 
names of parts of a piece of equipment. In that case, stimuli for overt student 
response may profitably be int^ated into the presentation of information to en- 
hance student learning. If you want such stimuli integrated into the presentation 
for relatively easy Type I instruction, type 1; if not, type 0. 

79b. Relatively difficult instruction often requires the student to spend some 
time absorbing many different intextelated items of infonnatioh. An example is the 
development of an understanding of how a i^irticular combat strata is related to 
the tactics required to can^ it out. 

Whether or not the use of int^^ted stimuli for overt student response during 
the presentation will enhance or hinder learning wUl depend largely on the skill of 
the writer, producer, or presenter of seU'-contdmed programs. If you want such 
stimuli integrated into the presentation for relatively difficult T^ype I instruction, 
type 1; if not, type 0. 

80. Tliere are several m|[tunente in favor of recording student responses even 
when the reisponses are not ^ be used for i^ormal exa^^ 
The student can use recorded realises for self-evaluation or tiie responses can be 
used in class to provide a springboard for cia^ discusfiion. The instructor can 
use the responses to diagnose student strengths and weaknesses so that subsequent 
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instruction (or even the course materials) can be tailored more precisely to student 
needs. 

In many instances, student responses are inevitably recorded when they are 
made. Some examples are handwritten or typed responses or studentrcreated pro- 
ducts. In other instances, responses may be ephemeral. For example, response-paced 
programs often register a response only long enough for the machine to react (or fail 
to react) to it. Spoken responses are the most common in classroom work and are 
rarely recorded. 

The decision at this point concerns only those responses that would not au- 
tomatically be recorded anyway. If such responses will be permanently recorded for 
later study by students or instructors, type 1; if not, type 0. 

81a. Many instructional system designers prefer that student responses be 
selected (that is, of the multiplenjhoice, true-false, or matching variety) rather than 
constructed, because such respo^ises are more easily checked and checking can be 
more objective; however, it is very time-consuming to write good questions that 
require selected response. For complex materials, such as those in which students 
must combine several interrelated skills to solve a problem, comprehensive diagno- 
sis of student learning by items calling for selected response will make migor de- 
mands on the skills of the item writers. 

This time may be well spent if many students are involved, however, because 
the checking of constructed responses can be time-consuming. 

81b. Student progress in. relatively easy Type I instruction can often be 
checked quite satisfactorily by eliciting selected responses. Constructed responses 
requiring the student to speak, write, draw, or otherwise produce somethir^, can 
provide richer information concerning the student's level of understanding or naas- 
tery. Sometimes, as in the teaching of spoken language, they are required. If you 
would prefer to elicit selected responses during relatively easy Type I instruction, 
type 0; if constructed responses, type 1. 

81c. You may be less willing to use selected responses to check on student 
mastery of relatively diflScult tasks because most selected responses do not reveal 
how a student arrived at his iselection. Clever writers, however, can reduce the 
possibility of a student choosing the right selection via the wrong route and can 
provide diagnostic information also. If you would prefer to elicit selected responses 
during relatively difficult Type I instruction, type 0; if constructed responses, type 
1. 

83. The student can receive the correct response or an example of an adequate 
response to each stimulus as part of the presentation a&er he has had time to 
r^pcnd. In this way, he receives immediate knowledge of his progress. Int^frating 
answers or models with tlie preaentation of stimuli incurs Utile addition^ cost in 
terms of writixig or presehtiniaf the material. However, waiting until all the students 
are finished and then giving the answers and scoring the.wqrk tc^ether can provide 
a valuable springboard for cla£» disciiMioh. Students who finish early can go on to 
other work while they wait for the others. 

If coirect responses ormodels are to be4)rovided along with the presentation of 
stimuli, type i; if not, type 0. 
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84.* Since you did not choose ezx instructor to present the instruction, it is 
possible to give someone responsibility for monitoring the class. A significant saving 
can result if the monitor is not an instructor. 

If you want an instructor as a monitor, type 1; if an instructor's aide, a clerk, 
or a student instructor will be sufficient, type 2; if a student leader, type 3; if no 
monitor, type 0. 

Policy Change 

86. You will now be asked to set instructional polity for relatively difficult T^pe 
I instruction, such as the teaching of concepts and principles. Depending on your 
philosophy of instruction, you may be more or less willing for the materials to be 
presented by a communication medium than you were for the relatively simple 
instruction. Also, you may be less willing to use selected response as a means for 
testing student mastery of the materials. If you want to alter the instructional policy 
you set for relatively easy T^pe I instruction v4th regard to relatively difficult Type 
I instruction, type 1; if not, type 0. 



TYPE n INSTRUCTION 

Individuoi or Interactive Skills 

90. You are now ready to set policy for 'Type H Instruction, which requires 
appreciable drill or practice but docs not require that studente work with special 
equipment or in a special location. Much Type n instruction deals with cognitive 
skills such as arithmetic, written compoeiiion, spelling, and problem solving. Type 
n instruction also deals witli psychomotor skills such as pronunciation of foreign 
words or penmanship, or spciri skills such as public speaking or the ability to 
contribute in small group discussions. 

We .first clasdfy Type H instruction on the basis of the way a class or group of 
studente will be organized when the drill or practice is under way. Generally, the 
studente will work individually; for example by practicing addition, writing senten- 
ces, drawing graphs, or responding to questions.t Qften„however, group participa- 
tion will be required, such as in.pwel discusd committee work, or dramatic 
presentations. A r^nt technique is to teach or reinforce skills by means of game 
playing. (Games i^equinng q^y minimal equipment such as paper and pencil, dice, 
or counters iure incliKied in T^ U inaction.) Included in the ^t^piy of interac- 
tive skills axe those requiring tHe i£uiivi4dai to address a group; public speaking or 
formal debate would also coihe under tim categoiy. 

* be x«ad if w }i30b^^ presenter, 
interac^ve skilk. Rather, esdi studmit ii dmlopix^ a skill be inU practice m an individual 
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Considering the course you are designing, what kinds of Type 11 instructional 
activities will be included? If individual performance will be used, type 1; if not, type 
0. Use the same code if game playing or other activities requiring groups of students 
to work together will be used or if an individual will have to address a group. 



TYPE n INSTRUCTION— INDIVIDUAL DRILL OR PRACTICE 
Complexity 

100. We classifjrT^n instruction by means of individual performa^ 
relatively simple and relatively complex, depending on whether sessions of fairly 
routine, repetitious, or automatic drill are needed, or whether several interrelated 
skills need to be developed. Simple Typ^ n instruction can include memorizing 
foreign worda, learning multiplication tables, reading numerical tables, plotting 
points on a graph, or practicing the formation of letters. Note, however, tiiat these 
may not be simple skills for some students, who may have to learn several skills, at 
once in order to master them. In addition, a skill such as learning to multiply 
numbers of several digits together may initially be relatively complex but may 
become relatively simple as students develop proficiency. Therefore, determining 
whether a skill is simple or complex depends on the level of prior student achieve- 
ment as much as it does on the skill itself. Your choices for simple Type II instruc- 
tional strata may be similar to those you made for simple Type I instruction 
because they will be based on your assessment of student ability and achievement 
as well as on instructor proficieupy. 

Complex skills include such activities as solving word problems in arithmetic 
writing a paragraph, showing relationships by means of a rough sketch, or compos- 
ing a speech. The development of complex skills may require close supervision 
during the initial phases of practice, because the student cannot know whether he 
is proceeding in the bright direction until he completes the work. 

If the course you are designing will include relatively simple Type n instruc- 
tion, type 1; otherwise, type 0. Use the same code for relatively complex instruction. 



TYPE n INSTRUCTION-INDIVIDUAL PERFORMANCE 

This section contains two sets of decision points for inidividual performance-^ 
relatively simple or relatively complex. Fojt conciseness, the sets are presented in 
parallel as in statement 110. 



113 



Scheduling of ?erfoniumce Sesrions 

UOsu First ycu must determine a strategy for relatively simple individual 
performance. Often, exercises are assigned for unscheduled study rather than being 
scheduled for a preassigned time for classroom work or supervised work at a com- 
puter terminal or audiovisual device. If all simple exercises are to be performed in 
unscheduled study, type 0; if some or all simple exercises will be performed in 
regularly scheduled sessions, type 1. 

110b. Now you must determine a strategy for relatively complex individual 
performance. Work on solving complicated problems, writing essays, and so on, is 
often assigned as homework or for special projects, rather than being scheduled for 
classroom work or supervised work at a computer terminal or TV display. If all 
complex exercises are to be performed in unscheduled study, type 0; if some or all 
complex exercises will be performed in regularly scheduled sessions, type 1. 

111a* Since you chose to conduct some or all simple exercises at regularly 
scheduled times and under supervidon, you will be asked to set isiitructional polipy 
first for the supendsed sessions. Then you will decide how skills should be demon* 
strated to the students. Finally, you will set policy for assignment of simple exercises 
for unscheduled study. 

lUb. Since all simple exercises ".ill be carried out in unscheduled study, you 
will first be aatesd to set polipy fOx ^ istrating the skills to the students. Then you 
will decide how to assign simple exercises. 

112a.t Since you chose to have students practice eome complex skills in regu- 
larly scheduled sessions and under supervision, you will be asked to set instructional 
policy first for the supervised sessions. Then you will decide how the skills should 
be demonstrated to the students.' Finally, you will set policy for assigning complex 
problems for unscheduled study. 

I12b. Since all complex performance will be carried out without supervision, 
you will first be asked to set policy for demonstrating skills to the students. Then 
you will decide how to make the assignments of problems for unscheduled study. 

Performance Mode! 

113. An initial learning event that demonstrates a skill each student should 
master can motivate and direct the students by providing them with a model and 
goals for performance4 Carefiilly developed, step^y-step discussion can be very 
efi'ective in this regard. The selection of means for demonstrating skills to students 
will hinge on questioniB of both practicality and effectiveness. If many students will 

* The computer will direct you to etatement Ula or lllb depending on which choice you made in 
•tttementllOit ^ 

tTlie computer dinacU the uaer to statenoento il2a or il2b depending on the choice made in ftate- 
ment llOb. 

:t Note that a performance model aa ueed here it difTerent fit>m the demonstration (presentation) of 
an idea or concept in Type I inatniction. The hitent it to dietittguieh hetwe^ 
will eventually copy and thoae that th^ will not 
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eventually observe the demonstrations, it may be well to make widely availabk^ the 
work of an instructor who is highly competent not only in the skills to be mastered 
but also in explaining the steps required for mastery. In addition, if small or par- 
tially hidden movements are involved, such as those required for pronundatiim, a 
communication medium can make these more visible to more students than can an 
instructor in person. A weU*written text can be used as well as film or other recorded 
media* If the material will need frequent revision, video tape of modularized text 
could be most practical Recorded demonstrations can also be studied independently 
or at a time of the student's own choosing. 

If only a few students will observe the demonstrationai and if the average in- 
structor is sufficiently competent in explaining what is to be learned, it may be best 
to rely on instructors to present whatever models are needed. In addition, during 
a demonstration in person by an instructor, the students can ask for clarification of 
pomts they do not understand. 

Finally, a good student can often demonstrate the skill to his classmates with 
minimal prior preparation (such as step^y*etep directions). Use of students to tdach 
other students reinforoas learning and can encourage a spirit of cooperation and 
interest 

In this section we smime that a model of performance involves no leamer(s) 
performance of the skilL A follow*me demonstration, in which students copy ste]>by- 
step procedures, can be used to introduce students to techniques for solving complex 
problems. We put foUow-me demonstrations in a separate categoiy of instruction. 
Thus, they will be treated as introductory practice sessions in teaching complex 
skills, not as pure models of performance. 

119a« If there will be an initial demonstration of a skill, it may be more practi- 
cal to use the same means of presentation as that used for the performance secision 
so that the transition will be least disruptive* 

lldb. In setting poli^r for simple individual performance with constructed 
response, you chose to present stimuli by the means the computer has just t,ffti 
out* If you would like to change your policy for demonstrating this perfomuince, 
type l;if not,^T)eO. 

U2c. In setting your polipy for complex individual performance with con- 
structed response, you chose to present problems by the means the computer has just 
typed out* If you would like to change your policy for demonstrating the perform- 
ance, type 1; if not type 0. 

113d In setting poligr for relatively easy Type I instruction, you chocie to 
present information hy the means the computer just typed put If you would lilce to 
change this policy for presenting models cf relatively simple performance, tyjpe 1; 
if not, type 0. 

llde. In setting policy for relatively difficult Type I instruction, you choie to 
present information fay the means the computer just typed out If you would lilce to 
change this policy for presenting models of relatively complex performance, ty^ 1; 
if not type 0. 

* You wm have been dii«etad to nuJwthaie choices Ortaten^ 
you readi this point 
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114, iVenthout^ scheduled sessions are not plaimed for simple 
you may want to schedule presentations of models of the skills to be mastered. This 
would be particularly true if an instructor will make the demonstrations/ITdemon- 
strations of simple performance are to be scheduled, type 1; if not, tyi4 0, ) 

115a, If an instructor will demonstrate a simple performance in pemMi/type 
1; if a communication medium, type 2; if a student leader, type 3; if a fixed-duration 
program, type 5. If you did not type 1, any policy established for discusdon sessions 
for basic instruction will be applied to discussion sessions for demonstratiocs. If you 
type 1, you will need to indicate the maximum size of the viewing gnmp in the 
Curriculum Analysis. 

116b. If an instructor will demonstrate a complex performance in person, type 
1; if a conununication medium, type 2; if a student leader, type 3; if a fixed-duration 
program, typfe 5. If you did not type 1, any poliqr established for discussion sessions 
for basic instruction will be applied io discusion semons for demonstrations. If you 
type 1, you will need to indicate the maximum siae of the viewing group in the 
Curriculum Analysis, 

llSct If you want any appropriate communication medium to present un- 
scheduled demonstrations of simple performance, type 2; if a fixed-duration pro- 
gram, type 5. 

11& If you will provide the instructor with a guide for making his demonstra- 
tion, type 1; if not, type 0. 

FoUow-Me Demonstrations or Step»by-Step Directions for 
Complex Performance 

120* FoUow-me demonstrations or step-by-siep directions can be used to in- 
troduce students to techniques for solving complex problems and are treated as 
introductory practice sessions in teaching complex performance. Because follow-me 
demonstrations combine presentation and student performance, they will require a 
separate set of decisions. Therefore, if these are included, the strategies you estab- 
lished for simple performance will not apply because they do not require follow-me 
demonstrations or step4>yrstep directions. 

If follow*me demonstrations or step4>y-step directions are included in your 
course, type 1; if not, typie 0. 

121. EH^en though sesdons for a>mplex performance are not acheduled during 
regular class hours,* you naay wish to give follow-me demonstrations or step4)y^p 
directions during scheduled instruction so that all students wiU receive essentiaUy 
the same initial directions and guidimce. If foUow-me demonstrations or fl[tep4>y^p 
durections during scheduled instruction are planned, type 1; if they will be given for 
homework, type 0. 

* Daddsd in itstement nOiL 

t WiU be read ifiiiswer to statement 114 if 0. 

t Decided in etatement llObu 



122au You should now choose the presenter for any foUow*me demonstrations 
or step4>y<step directions you may schedule. In general, logistic considerations may 
dictate that follow*me demonstrations and initial directions for the performance 
that succeeds them should be presented 1^ the same meaiui. There may be situa* 
tions, however* in which the means should be diflerent-^or example* when the 
follow*me demonstrations should be presented by a knowledgeable person but a 
studrat leader may present initial practice directions, or when the students perform 
in unscheduled study but receive scheduled foUow^e demonstrations or step^* 
step directions. An advantage to a fixed-durati<Hi program is that it can be used to 
assure that all students take the same amount of time in observing the demonstra* 
tions and will thus all begin the perf .mance portion simultaneously. 

After you choose the presenter for follow*me demonstrations, specify strategy 
for presenting initial directions for complex performance. 

If you want an instructor to present foUow^me demonstrations, type 1; if any 
appropriate communication medium, type 2; if a student leader, type 3; if a fixed* 
duration program, type 5. 

122b. Now choose the presenter for any foUow-me demonstrations or step4)y* 
step directions you wish to provide for unscheduled study. Again, logistic considera* 
tions may dictate that foUow-me demonstrations and initial directions for the per* 
formance that succeeds them durectly should be presented by the same means. 

After the presenter for foUow-me demonstrations is chosen, return to decudons 
about presentation of directions and stimuli for complex performance. 

If you want an appropriate cooununication medium to present foUow^me 
demonstrations, type 2; if a fixed-duration program, type 5. 

123.* If you will provide the instructor with a lesson guide for making his 
foUow*me demonstration or for givi jg step4>yHrtep directions, type 1; if not, type 0. 

Unscheduled Study 

124a« Esjrlier you indicated that some simple student performance would be 
scheduled. If you also wish to assign simple performance for unschediiled study, type 
l;if not, type 0. 

124b. EarUer you indicated that some complex student performance would be 
scheduled. If you also wish to assign complex performance for unscheduled study, 
type 1; if not, type 0. 

125a* t For unscheduled simple performance, the presentation of stimuli that 
call for selected responses may be made by any api>ropriate communication medium, 
or it may be made a spedal type of presentation/response qrstem, specifically: 
a fixedHliiration prpgram, a rMponse-paoed program, or an adaptive program* Each 
has its advantae^ and disadvantages. 

* Tbbemdocdyifaiimrtditate^ ^ 1 

t The pMt ofitateme^ 125 that wiU be raad 
in iCni ct iop if betas oooiidered, but alio on idieUier thie perftrmaaoe may be dieeked by aeleeted 
reipooee or Igr oooatnicted rapooee. 
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If you select any appropriate communication medium, the final choice of a 
specific medium will be based on considerations of appropriateness and your design 
criteria* 

A fixed-duration program has the advantage of forcing the student to respond 
at a preset rate* This may be desirable for devialoping speed of response* 

The adaptive program not only accepts and acts on student responses, but also 
provides problems of varying levels of difficulty based on student responses* Because 
the adaptive program includes branching of various types, it is the most expensive 
to prepare and administer; it can take several times as long to write as a nonadaptive 
program* 

If you want an adaptive program to present stimuli for simple performance, 
type 4; if a fixcdniuration program, type 6; if a »«sponse*paced program, type 7; if 
any appropriate communication medium, type 2* 

125b* For unscheduled simple performance, the presentation of stimuli that 
may not be answered by selected responses may be niade by any appropriate com- 
munication medium or may require a fixed-duration program* If you select any 
appropriate communication medium, the final choice of a specific medium will be 
based primarily on considerations of appropriateness and your design criteria* A 
fixed-duration program has the advantajg^ of forcing the student to respond at a 
preset rate* This may be desirable for developing speed of response* 

If you want a fixedniuration program to present stimuli for simple performance, 
type 5; if any appropriate communication medium, type 2* 

125c* For unscheduled complex performance that may be checked by selected 
response, the presentation of directions and stimuii may be made by any appropriate 
coumunication medium, a response^paced program, or au adaptive program* (Be* 
cause the development of speed of response is probably not an objective in this type 
of instruction, the fixedniuration program is excluded from these choices*) Again, 
each of these has its advantages and disadvantages* 

If you select any appropriate communication medium, the final design choice of 
a specific medium will be based primarily on considerations of appropriitteness and 
your design criteria* 

A reeponse^paced program acconmiodates the rate of presentation to student 
response and provides automatic knowledge to ^tfae student about whether his re- 
sponse was correct or incorrect 

An adaptive program not only accepts and acts on student responses but also 
branches to problems of varying levels of difficulty based on student responses* Such 
a program, however, is ihe most expensive to prepare and administer. 

If you want an adaptive program to present directions and problems for com- 
plex performance type 4: if a response-paced program, type 7; if any appropriate 
communication medium, type 2* 

125d For unscheduled complex performance that may not he checked by se- 
lected response, th3 presentation of directions and problems cannot be made hy 
automated proga^ams* Hence, only an appropriate communication medium can be 
used, and you have no decision to make* 
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126a« It is a relatively simple matter to supply the student with the correct 
answers to his exercises, especially when they call for selected responses. Answers 
allow the student to check his own progress in unscheduled study and may help him 
redirect his efforts until he discovers how to find the right solution. Providing 
answers, however, may make it harder to find out whether the student has actually 
done the work. Quizzes, classroom questions, and the like may then be needed. 

If you want to supply the answers along with the problems assigned for un- 
scheduled study, type 1; if not, type 0. 

126b. When exercises call for constructed student responses, it may be difficult 
to int^rate the presentation of any correct aikwer \with the presentation of the 
problems themselves. This is especially true for complex problem-solving requiring 
creation of new materials, such as .in essay wnting. 

If you want to supply models of acceptable answers along with the problems 
assigned for unscheduled study, type 1; if not, type 0. 

127a Unscheduled performance sessions can be made much more effective as 
teaching techniques if the student can record his responses and have his perform* 
ance evaluated either by himself, the instructor, or his peers. Some T^P^ H instruc- 
tion may call for special equipment beyond the traditional paper and pencil for 
recording student responses. For example, practicing pronunciation can be more 
effective if a record is made on audio tape; practicing a speech may be recorded on 
video tape. 

127b. If you would like to provide whatever equipment is needed to record a 
student's response in unscheduled simple performance, type 1; if not, type 0. 

127c. Ix you would like to provide whatever equipment is needed to record a 
student's u]::scheduled complex performance, type 1; if not, type 0. 

Teat Responses 

In the Curriculum Analysis you designated which skills require constructed 
student responses aud which may make use of selected student responses for infor- 
mal diagnosis of stude:it progress during ongoing instruction. You will now decide 
to what extent these designations should apply in formal examinations. 

130a. It may or may not be possible to examine student mastery of simple skills 
by means of objective teste; Skil^ that require pq^homotor responses, such as 
pronouncing words or forming letters, cannot be examined in this way. 

If it will be possible to examine student mastery of a// ample skiUs taught in 
your course by objective teste and if you would like to dp so, type 1. If student 
mastery of siinple skills that you ded^^nated foir constructed responses during in- 
struction should also be exainined by^t^ calling for constructed responses, type 2. 

130b. It may not be pdssiblei to ^camine student mastery of complex skills by 
objective teste. Skills that reqiure psychomotor responses, such as public tpeaking, 
for examnie, cannot be exaxnined in this way^ 

If it will be possible to examine student mastery of a//complex skills taught in 
your comise by objective teste and if you wouljd tb do so, type 1. If student 
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mastery of those complex skills designated for constt ucted responses during instruc* 
tion should be examined by tests calling for constructed responses, type Z 

131a. * You may have decided against selected responses to check student pro- 
gress in mastering simple skills because such responses do not permit full diagno- 
sis.* It is still possible that examinatione could be objective, if they will not be used 
as diagnostic instruments. 

If objective tests would be useful to examine student mastery of simple skills in 
your course, lype 1; if not, type 0. 

131b. You may have decided against selected responses to check student pro- 
gress in mastering complex skills because such responses do not permit full diagno- 
sis.* It is still possilbe that examinations could be objective, if they will not be used 
as diagnostic instruments. 

If objective tests would be useful to examine student mastery of complex skills, 
type 1; if not, lype 0. 

Grouping 

You will be directed to this section only if in the Statement of General PoUpy 
you chose to specify different strategies of instruction for different student learning 
capabilities. 

135. To adapt instruction to student capabilities, you may place students in the 
following groups: slow and average-to4>right; slow, average, and bright; dow-to- 
average and bri^t Alternatively, you may tailor instruction to each individual 
student 

135a. In setting strata for relatively easy l^pe I instruction, you chose to 
group your students into the types the computer just printed out If you want to 
change this strategy for relatively simple l^ype n instruction, type 1; if not, type 0. 

135b. In setting strata for relatively difficult l^pe I instruction, you chose 
to group your students into the types the computer just printed out If you want to 
change this strata for relatively complex l^ype n instruction, type 1; if not, type 
0. 

135a To adapt relatively simple Type TL instruction to student capabilities, you 
may place your students into several types of groups or treat them individually. If 
two capability levels will be used, slow and avi^rage^o^right, type 1; if three, slow, 
average, and brij^t; type 2; if two, slow-to^verage and bright, type 3; if students will 
be treated individually, type 4. 

135d. To adapt relatively complex Type n instruction to student capabilities, 
you may place your students into several types of groups or treat theni individually. 
If two capability lev^ will be usec^ slow and average-to-brie^t, type 1; if three, slow, 
avarage, and bi^t, type 2; if two, sldw-to^verage and bri^t, type 3; if students will 
be treated individually, type 4. ' 

* llieoompttterwmhavedixiKtedyouto 
statement 131. 
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Variable Pacing , ^ 

The computer will direct you to this section if you chose variable pacing for all 
or parts of the course. If you did not choose it for a// of the course, you must decide 
whether to use it in the part of the course to which your current decisions pertain 
(statement 137). 

137a. During the initial phases of a simple exercise, it may be well to adjust 
the presentation of stimuli to the student's individual learning rate, unless the skills 
to be learned are very simple. As the student's response becomes more automatic 
with repeated drill, hoover, and if speed of response is to be developed, you may 
wish to shift to fixed pacing later in the session. If speed of response is not an 
objective, however, or if the studente are highly motivated to master the materials 
as quickly as possible, it may be most efficient to use variable pacing throughout all 
simple exercise. 

If variable pacing is desired throughout simple performance sessions, type 1; if 
only during the initial phases of the sessions, type 2; if not at all, type 0, 

137b. For relatively difficult l^pe I instruction, you chose the policy the com- 
puter just typed out with r^ard to variable pacing. If you want to change this policy 
for relatively complex performance, type 1; if not, type 0. 

137c. If you want to use variable pacing for relatively complex performance, 
type 1; if not, type 0. 



Type of Response 

140a. Although student progress in Type I instruction can almost always be 
checked by having the student respond selectively to questions, student progress in 
Type n instruction frequently cannot be checked in this way. Any instruction involv- 
ing p^chomotor skills such as speaking, writing, or drawing requires constructed 
responses. There is a tradeoff between the number of studente who will work with 
the material Hr/r he time required to write the questions requiring selected re- 
sponse. 

140b. If constructed responses will be used for diagnosing student progress in 
mastering simple skills, type 1; if not, type 0. Use the same coding for selected 
responses, if you are unsure, type 1 for both.* ^, * 

140c. It is very difficult to diagnose a student's progress comprehensively in 
mastering complex skills by means of selected response. If the student fails to choose 
the right final answer, there is no way of determining at whiat point in the process 
his work was faulty. In some cases, such as essay writing, no right answers exist. 
Thus, selected r^ponses may not be useful for asidstmg the instructor or the stu- 
dent, particularly during early learning phases. 

If you will want to.use constructed responses for diagnosing student progress in 
mastering complex skills, type 1; if not, type 0. Use the same coding for selected 
responses. If unsmre, type 1 for bath.* 

• At this point the computer gives you the opportunity to choooe either selected or constnicted 
responeee or both. 
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TYPE n INSTRUCTION-SIMPLE INDIVIDUAL PERFORMANCE 

This section contains two sets of decision points pertaining to simple Type II 
instruction for individual performance— a cat^ory requiring constructed I'esponses 
and a cat^ory requiring selected responses. For conciseness, the sets are presented 
in parallel as in statement 145. 

145a. Now you will decide how to conduct supervised sessions of simple per- 
formance involving constructed student responses. 

145b. Now you will decide how to conduct supervised sessions of simple per- 
formance-involving 5e/ec^ student responses. 

146.* You are now going to determine strategy for relatively simple Type H 
instruction that wiU permit selected student responses. The use of selected responses 
adds the possibility that they may be scored objectively, quickly, and even automati- 
cally, and that automated programs may be used. If you want to change the policy 
you just set in order to add automated scoring or for any other reason, type 1; if not, 
typeO. 

Adapting Instruction to Student Capabilities 

You will be directed to this section only if you chose in the Statement of General 
Policy to specify different instructional strategies for different student learning 
capabilities for all or parts of the course. If not, you will be directed to statement 
155 (controller of pacing) or statement 160 (presentation). 

150. Adapting instruction in simple skills to student capabilities may involve 
little beyond deciding whether or not sets of exercises at several levels of difliculty 
will be needed. Then the instructor, a student leader, or even an individual student 
may choose the appropriate materials. Read the considerations about the logical 
consequences of choosing an instruc .or, student leader, or individual student for this 
role, discussed in statements 61a and 61b. 

150a. Much recent work with computer-assisted instruction has centered on 
developing programs that will adapt the instruction to the student's prior knowledge 
and learning style. Read the considerations about the logical consequences of choos- 
ing an adaptive program for this role, discussed in statement 61a« 

151a. For relatively ea^ Type I instruction, you selected the means the com- 
puter just designated to adapt instruction to meet student needs in the groups 
chosen and to present information to them. If you want drill sessions with con- 
structed responses to be handled by a different means, type 1; if not, type 0. 

151b. For relatively easy Type I instruction, you selected; the meai3 the com- 
puter just designated to adapt instruction to ineet student needs in the groups 
chosen and to present infomlation to them. If you want drill sessions with selected 
response to be handled by a different means, type 1; if not, type 0. 

^ This statement is read instead of statement 145b if strategy is already determined for simple 
instruction with constructed response. 
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152a. ♦ If you want the instractor to adapt the instruction for relatively simple 
performance, type 1; if each student, type 3; if a student leader, type 4. 

152b.t If you want the instructor to adapt the instruction for relatively simple 
performance, type 1; if an adaptive program, type 2; if each student, type 3: if a 
student leader, type 4. 

152c.t Because you chose to have all students master the course objectives on 
a fixed schedule, it would be unwise to allow a student leader or an individual 
student to choose instructional method. He might not be able to budget his time well 
enough to keep up with the rest of the class. Read the considerations about the 
logical consequences of choosing an instructor or an adaptive program for this role, 
discussed in statement 61a- 

If you want the instructor to adapt the instruction, type 1; if an adaptive pro- 
gram, type 2. 

152d.* Because you chose to have all students master the course objectives on 
a fixed schedule, it would be unwise to allow a student leader or an individual 
student to choose instructional method. He might not be able to budget his time well 
enough to keep up with the rest of the class. Hence, an instructor must adapt the 
instruction. 

Controller of Pacing 

The computer will direct the user to this section if he chose to use variable 
pacing for simple n instruction m individual skills. 

155a. Now you must choose who will control the pacing ofthe presentation of 
stunuli. Since the pacer may also be the presenter, and presenting stimuli for 
relatively simple performance may be boring to the instructor, students could act 
as drill masters. Read the considerations surroimding and logical consequences of 
choosing the instructor, the student leader, or the mdividual student as pacer, 
discussed in statement 71a. 

155b. For relatively easy T^pe I instruction, you chose to have the information 
paced to fit student learning rates by the means designated by the computer. If you 
wish to pace the presentation of stimuli for simple performance with constructed 
response in the same way, type 0; if not, type 1. 

155c. For relatively easy T^ype I instruction, you chose to have the information 
paced to fit student learning rates by the means designated by the computer. If you 
wish to pace the presentation of stimuli for simple performance with selected re- 
sponse in the same way, type 0; if not, type 1. 

155d. When selected responses are used, it is also possible to choose a response- 
paced program to control pacing. Stimuli are presented via a communication 
medium and the program senses student responses: Read the considerations sur- 
rounding and logical consequences of choosing a resix>nse-paced program as pacer, 
discussed in statement 71a. 

* Read for constructed response, 
t Read for selected response. 
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155c.* If the leader of a small group should r^ulate pacing, type 1; if the 
individual student, type 2; if the instructor, type 3. 

155f.t If the leader of a small group should r^ulate pacing, type 1; if the 
individual student, type 2; if the instructor, type 3; if a response-paced program, type 
4. 

Presentation 

The following set of statements will be read for presentation of instruction in 
two cases: (1) if instructional strata Avill not be tailored to student learning 
capabilities and there is no variable pacing*, or (2) if an instructor is to tailor instruc- 
tional strata to student learning capabiKties. In all other instances, the presenta- 
tional means and other matters will have already been determined. 

160a. Presenting stimuli for simple skills can become boring for an instructor. 
A student leader can provide this functiou, or the mdividual student can work from 
a communication medium. A special case is a fixed^uration program; these can be 
useful if a minimum rate of student response to stiiauli is to be developed. 

160b. The computer has typed out the means you chose for presenting informa- 
tion in relatively easy Type I instruction. If you wifth to use the same means for 
presenting stimuli for simple performance with const ructed response, type 0; if not, 
type 1. 

160c. The computer has typed out the means yo u chose for presenting informa- 
tion in relatively easy Type I instruction. If you wish to use the same means for 
presenting stimuli for sunple performance with selected response, type 0; if not, type 
1. 

160d. If you will use an instructor to present directions and stimuli, type 1; if 
any appropriate communication medium, type 2; if a student leader, type 3; if a 
fixed-duration program, type 5. 

160e. With selected responses usijble, you may also choose a response-paced 
program to present stimuli. Such a program adjusts the presentation rate by stop- 
ping after each question and waiting for correct student response before proceeding, 
which may be desirable in drill exercises. 

If you will use an instructor to present directions and stimuli, type 1; if any 
appropriate communication medium will suffice, type 2; if a student leader, type 3; 
if a fixed-duration program, type 5; if a response-paced program, type 7. 

161a. Because students must master the basic course materia! j on a fixed 
schedule, it is probably best for the instructor to o^/ersee student performance. 
Because presenting stimuli for simple performance can become boring for an in- 
structor, you may prefer that he supervise student worlc with communication media* 
A special case is a fixed-duration program; these can be useful if a Tnininmni rate 
of student response to drill stimuli is to be developed. 

^ Read for constructed response, 
t Read for selected response. 
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161b. If you want the instructor to present directions and stimuli, type 1; if any 
appropriate communication medium, type 2; if a fixed-duration program, type 5. 

161c. Because student mastery of simple skills may be dia^osed by selected 
responses, it is also possible to use a response-paced program to present stimuli. Such 
a program may be particularly useful for slow students because it automatically 
provides them with knowledge of their progress and can be more effective in retain- 
ing their attention. 

If you want the instructor to present directions and stimuli, type 1; if any 
appropriate communication medium, type 2; if a fixed-duration program, type 5; if 
a response-paced program, type 7. 

162. Unless student responses are being used to evaluate the student's mastery 
of a skill or to diagnose his strengths and weaknesses, the student may receive the 
correct response to each stimulus as part of the presentation after he has had time 
to respond. In this way, he learns immediately of his progress. Integrating the 
responses with the presentation of stimuli incurs little additional cost in terms of 
writing or presenting the material. Although it can encoiurage the student to have 
a greater sense of responsibility for his own learning, waiting to score responses 
until all the students are finished can previde a valuable springboard for class 
discussion. 

If the correct responses will be provided along with the presentation of stimuli, 
type 1; if not, type 0. 



TYPE n mSTRUCnON-COMPLEX INDIVIDUAL PERFORMANCE 
Policy Change 

170. You will now set instructional policy fi)r relatively complex Type n in- 
struction, such as teaching problem solving. Depending on your instructional 
philosophy, you may be less willing for a communication medium to present the 
stimuli than you were for relatively simple performance. Your choices for adap- 
tivity, variable pacing, and the like may also be different if you anticipate .a wider 
range in student abiHties at higher levels of learning. In addition, complex ^>pe n 
instruction may not lend itiself as readily as simple l^pe n instruction to evaluation 
by means of selected student responses. 

J Keeping these points in mind, review the learning events in the Curriculum 
Analysis that were singled out for T^pe n instruction. Then, if the instructional 
strategy set for relatively simple Type II instruction will be altered with regard to 
relatively complex T^pe H instruction, type 1; if not, type 0. 

Setting Strategy 

This section contains two sets of decision points pertaining to complex T^pe n 
instruction for individual performance— a cat^ory requiring constructed responses 
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and a cat^ory requiring selected responses. For conciseness, the sets are presented 
in parallel as in statement 175. 

175a. Now determine an instructional policy concerning how to conduct sche- 
duled sessions of complex performance involving constructed student responses. 

175b. Now determine an instructional policy concerning how to conduct sche- 
duled sessions of complex performance involving selected student responses. 

176. ^ Now set policy for relatively complex Type n instruction that will permit 
selected student responses. The use of selected responses adds the possibility that 
they may be scored dbjectively, quickly » and even automatically, and that automated 
programs may be used..If you want to change the policy you just set in order to add 
automated scoring or for any other reason, type 1; if not, type 0. 

Adapting Instruction to Student Capabilities 

, You wiU be directed to this section only ifyou chose to specify different instruc* 
tional strat^es for different student learning capabilities for all or parts of the 
course in your Statement of General Policy. If not, you will proceed to statement 185 
(controller of pacing) or statement 190 (presentation). 

180. Adapting instruction in complex skills to student capabilities nmy involve 
establishing a sequence of related objectives or a hierarchy of objectives. Each 
student*s initial skills required for steps in the sequence will probably be somewhat 
different. Moreover, the sequence appropriate for one student may be different from 
that appropriate for another. It is likely that good decisions about such matters will 
require a high degree of instructional skill. Read the considerations surrounding 
and logical consequences of choosing an instructor, student leader, or individual 
student for this role as discussed in statements 61a and 61b. 

180a. In some highly structured subject areas, such as mathematics or physics, 
some adaptive programs have been worked out to acconunodate differences in stu- 
dent learning abilities and are generally available. Read the considerations sur* 
rounding and logical consequences of choosing an adaptive program for this role as 
discussed in statement 61& 

181a* For relatively difficult Type I instruction, you selected the means the 
computer just designated to adapt instruction to meet needs of individual students 
in the groups shown and to present information to them. If you want performance 
of complex skills with constructed response to be handled by a different means, type 
1; if not, type 0. 

181b. For relatively difficult l^pe I instruction, you selected the means the 
computer just designated to adapt instruction to meet needs of individual students 
in the groups shown and to present information to them. If you want performance 
of complex skills with selected response to be handled by a different means, type 1; 
if not, type 0. 

* This statement is read instead of statement 175b if strategy is already determined for complex 
instruction with constructed response. 
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182a.* If the instructor will adapt the instruction for performance of relatively 
complex skills, type 1; if the student, ^rpe 3; if a student leader, type 4. 

182b.t if the instructor will adapt the instruction for performance of relatively 
complex skills, type 1; if an adaptive program, type 2; if the student, type 3; if a 
student leader, type^ 4. 

182c.t Because you chose to have all students master the course objectives on 
a fixed schedule in the Statement of General Policy, it would be unwise to allow a 
student to choose instructional method. He might not be able to budget his time well 
enough to keep up with the rest of the class. 

If the instructor will adapt tiie instruction, type 1; if an adaptive program, type 

2. 

182d.* Because you chose to hi^ve all students master the course objectives on 
a fixed schedule in the Statement of General Policy, it would be unwise to allow a 
student to choose instructional method. He might not be able to budget hi>s time well 
enough to keep up with the rest of the class. Hence, an instructor must adapt the 
instruction. 

Controller of Pacing 

The computer will direct you to this section if you choee variable pacing for 
complex Type n instruction in individual skills. 

185a. Now choose the controller of pacing stimuli for performing complex 
£kills. Read the considerations surroimding and logical consequences of choosing the 
instructor, the student leader, or the individual student as discussed in statement 
71a. 

185b. For relatively difficult Type I instruction, you chose to have the presenta- 
tion of information paced to fit student learning rates by the means just designated 
by the computer. If you wish to use the same meamf for presenting directions and 
suggestions for the performance of complex skills with constructed response in the 
same way, type 0; if not, type 1. 

185c. For relatively difficult Type I instruction, you chose to have the presenta- 
tion of information paced to fit student learning rates by the means just designated 
by the computer. If you wish to use the same means for presenting stimuli and 
directions for performance of complex skills with selected response, type 0; if not, 
typel. 

186d Whra selected responses are used, it is also possible to choose a response- 
paced prograni.to control pacing. A communication medium presents stimuli, and 
student responses are entered into and evaluated by the program. Read the consider- 
ations surrounding and logical consequences of choosing a response-paced program 
as pacer as discussed in statement 71a« 

* R^d for oonttrueted' ra^nte 
t Read for selected reqsqose/ 
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Praeentatioii 



190a. The presentation of directions and stimuli for performing complex skills 
is probably the least demanding part of this kind of instruction. Performance models 
and folIow*me demonstrations of such skills require the most knowledge on the part 
of the presenter. 

190b. The computer has typed out the means you choee for presenting informa- 
tion in relatively difficult T^pe I instruction. If you wish to use the same means for 
presenting stimuli and directions for performing^complex skills with constructed 
response, type 0; if not, type 1, 

190c. The computer has typed out the means you chose for presenting informa- 
tion in relatively difficult Type I instruction. If you wish to use the same means for 
presenting directions and stimuli for performing complex skills with selected re- 
sponse, type 0; if not, type 1. 

191. Since students must master the basic course materials on a fixed schedule, 
it is probably best fi)r the instructor to oversee student performance of complex 
skills. However, presentation of stimuli and directions does not necessarily require 
the instructor's attention^ and you may prefer that he supervise the students while 
they work with conmiunication media. LP the instructor will present directions and 
stimuli, type 1; if any appropriate communication medium, type 2. 

192. U&icss student responses are being used to evaluate Uie students mastery 
of a skill or to diagnose his strengths and weaknesses in highly structured subjects 
such as arithmetic or engineering, the student can receive the correct answer to each 
problem after he has had time to work it himself. In this way, he learns something 
about his progress; and even though the answer does not provide diagnostic informa- 
tion, he may hi able to find his errors by working t^ackwards. 

In other areas, however, such as written composition, creative photography, 
and the like, there is no right answer for a particular assignment. But the student 
can be supplied! with models of accepted practice to compare with liis own work. 

integrating the responses in highly structured subjects by presenting stimuli 
incurs little additional cost in terms of writing presenting the material. In un- 
structured areas, however, it may require production or reproduction of complex 
products such as diagruns and the lil^. In either case, encouraging the student to 
judge his own work can heighten his perceptions, increaise his sense of responsibility 
for his own pn^^ess, and develop self-instructional skills. 

In highly structurad areas, delays may be introduced by waiting to score re- 
sponses until all the students are finished in order to provide a springboard for class 
discussion. In addition, teaching students to work bsudcwards from answers may be 
a poor tactic if skilb of synthesis, rather than analyst, are being tau^t 

If responses or models are provided along with iiie presentation of stimuli, type 
1; if not, type 0. 

193. There are several arguments in fovor of recording student responses even 
when the responses will not be used for formal examination of student progress. 
Recorded responses can be used by the student for self-evaluatioh or they can be used 
in class to provide a springboard for class discussicm. The instructor can use them 



12j3 



to diagnose student strengths and weaknesses so that subsequent instruction (or 
even the course materials) can be more precisely tailored to student needs. 

Recording of constructed responses can be time consuming; and expensive, how- 
ever, particularly if special recording equipment such as video-tape machines is 
required. 

If student responses will be permanently recorded for possible later evaluation 
by students or instructors, type 1; if not, typn 0, 
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PROGRAM OUTPUT FOR BASIC STILL PHOTOGRAPHY 

COURSE 



This appendix contains an example of the DISTAF program ou^at, a specific 
strategy of instruction* It also presents the T^ri of the interaction between the 
user and the computer as the user established the strata* 

The DISTAF output, A Strategy for Teaching a Course in Basic Still Photogra- 
phy is a shortened and revised version of an actual course given to airmen in the 
Technical School at Lowry Air Force Base* It was chosen because the Air Force Plan 
of Instruction provided a detailed statement of the curriculum for the course and 
because the course contained a fably wide range of different kinds of teaching 
situations from classroom presentation and discussion to exercise of students* photo- 
graphic skills in the darkroom and out of doors* Each type of iiuitruction ofibred a 
wealth of material for the application of novel teaching techniques* 

The strategy was devised with the idea that the course would be presented at 
an Air Force Technical School and would produce about 2600 graduates annually* 
The nominal course length is two weeks, and the average student load is 100« An 
instructional system that could be used to teach the course using the stated strategy 
has been deigned and costed. This system is described in detail in R-1021*PIt^ 

The DISTAF output that follows is .largely self^Ianatoiy* Note that, in gen« 
eral, strategy decisions are grouped by category of instruction* The exception is that 
the leader for follow*me demonstrations is displayed along with decisions for student 
performance because of the similarity of thase two categories* Sometunes student 
performance can be checked by calling for selected responses even though the stu- 
dent is actually making constructed respomses as he performs* The choice of the 
leader for follow*me demonstrations of such skills appears along with the choice of 
whoever gives directions or problems for solution because quite logically they may 
be the same agency* 

Note also that there is no output for the strategy for I^pe m instruction, since 
that part of the program has not been completed* 

* Petnitchdl snd Ctrpenter^ op. cit 
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In the Record of Computer^User Interaction, all of the phrases and directiona 
shown have been typed out by the computer except for the numbers following equal 
signs (=), which the user types in. The reader may find it usead to follow this 
interaction with the help of the User's Manual, Ai^ndix B. 



A STRATEGY FOR TEACHIWfG A COURSE IN BASIC STILL PHOTCGIUPHT 
EKTIKE COURSE 

StudsAts will not take coc te %.ork other than basic work. 

Instructional atrategias Mon*t.ba tailored to the students* capabilitiaa. 

Thera will be no raaedial saasiona« 

Students will abater the course on a variable schedule. 

Variable pacing will be uaed throughout the course. 

Added reirarda will not be used to provide aotivatioo. 

The followlnc t/pes of instruction wiU be used: 

T/pe t instruction ' 

T/pe 2 instruction 

T/pe 3 instruction 



ALL or TYPES 1 AMD 2 INSTRUCTION 
Tests will be conducted on the following schedule 
After each topic 
At the end of the course 
Test inforsMticns 
For each topic quis 
The teat length is IS ainutes. 
No proctor will be needed. 
The content covered will be 
only the topic just coapleted. 
No tlM will be allocated for revisw. 
Test infcTMtiont 
For the final examination 
The teat length is 360 ainutes* 
No proctor will be needed. 
The content covered will be 
the entire course. 

The student will review at a scheduled tiae under supervision. 

Special Mterials will be prepared for thia revisw. 

Thia review wlU take tiie average student 120 ainutes to conplete. 
Part of the working will be used to grade formal exaKl.nationa. 
Fomal exiAinationa by neans of objective teats 
will be Mchine scored. 

The studei^t can discuss saterial presanted by coMunlcation aiedia 

in a special session with the instructor* 
Discussions will be scheduled during regular class houx^^ 

10 percent of the presentation tine will be used fof* discussion sessions. 
Discussion aessions will occur when 1$ nin. of diseuiision have accuimlated. 
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FOR ALL TTPB 1 IHSTRUCTJOII 

All foTMl •xMiMtiom vill b# obj«cti^ fuU. 
ItovitM ud fonMl wcwiMtioM win hm prM«ct«d by 
th« 9mm mum «• th« orif inal imtruetlon. 
Students will not hxtm hoMifGrk* 



FOR KEUTXVCLT ZK^ TYPE 1 ZKSTKUCTZOll 
Facinf will b« controlled by 

« rMponso*iNiic*d progrM* 
Each studtnt will procood at his own r«t«« 
Pr«8«nt«tion is by 

a r«sponss*pscsd progrM* 
Ho Monitor will bo nocosssry, 
Stimli for o¥ort studsnt response 

srs intsgrstod into ths prossntntion. 
Studsnt rosponsss srs porMnsntly rtcordsd* 
Sslsctsd rssponsss srs rsquirsdr 
Ths studsnt will bo given tiis correct rssponss* 



FOR RELATIVELY DIFFiaLT TYPE 1 INSTRUCTION 
Pacing will be controlled by 

the individual studsnt* 
Each studsnt will proceed at his own rats* 
Prtssntation is by 

any appropricits en— unlcation nediu*. 
Ho Monitor will be necessary. 
StimUl for overt studsnt rssponss 

are integrated into the pressntation* 
Studsnt responsss are permanently recorded* 
Selected responses are required* 
The student will be ^iven the correct rssponss* 

ALL OF TYPE 2 INSTRUCTICW 

Individual practics or drill will bs used* 
Relatively complex instruction will be used* 



TYPE 2 COMPLEX INSTRUCHON 

ExsMination of studsnt aastsry of skills dssignatsd for construetsd 

rssponss will call for constructed responses. 
Reviews and forMl exaidhations will be pressnted by 

tiie ssM Mans as ths original instruction* 
Studsnts will not have hoMwork* 
Modsls of student performance will be presented ^y 

a live instructor* 
The instructor will bs provided a guide for demonstrating performance* 
FoUoM^ms dsmonistraticns will bs ussd in ths courss. 
FoUow-ms dsmomstrations will bs sdMdulsd during regular class hours* 

TYPE 2 COifPLD^ INSTRUCTION 
WITH CONSTRUCK:^ RESPONSE 
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Folloir-aie dMonstrations will be presented by 
a live icetructor* 

The instructor will be provided a guide for foUow-M deaonstretioos* 
Pacing will be controlled by 
an instructor* 

Each student will proceed at his own rate* 
A prograaned guide will not be supplied* 
Presentation is by 
a live instructor* 

Materials will be supplied for the instructor* 
Stimili for overt student response 
are integrated into the presentation* 
St\ident responses are perMnently recorded* 
Constructed responses are required* 
The student will be given the correct response* 

TTPE 2 COMPLEX IKSTRUCTION 
VITH SELECTED RESPWSE 

FoUow-M dcnonstratiom will be presented by 
a live instructor* 

The instructor will be provided a guide for foUow-ae demonstrations* 
Pacing win be controlled by 

the individual stwient* 
Each student will pr?<ceed at his own rate* 
Presentation is by 

any cosmnication aedlua* 
Mo sonitor will be necessary* 
Stinuli for overt student response 

are integrated into the presentation* 
Student responses are peremently recorded* 
Selected responses are required* ' 
The student will be given -d&e correct response. 



RECORD OF COMPUTER-USER INTERACTION 

This section of the questioning pertains to the questionnaire 
which you filled out prior to beginning this session* 
Please type for yes answers and 'O* for no answers* 

Question 2^1 

Question 5^0, ^ 

Question 8-0 

Question 1^ ^ 0 



The headings will rewind you of the category of instruction 
to which the current decisions pertain* 

ENTIRE COURSE 

Please read statement 8* 

Variable pacing s 1 

Please, read statsMnt 9.b* 

Added reiiar^is s 0 

Pl^se read statement 11* 
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Type 1 = 1 
Type 2=1 
Type 3 = 1 



ALL or TYPES 1 AND 2 IHSTRUCTIOK 



Please reed stete»ent 15. 
Please read statenent 15 a. 
Please read stateMent 16 b. 
Test after 

Topic = 1 

Major section s o 

Course = 1 



For topic quiz 
Please read statewnt 17. 
Test length(Binutes) = 15 
Please read stateaent 18. 
Please read statewnt 19 a* 
Content tested = 1 
Please read stateaent- 21. 
Proctor = 0 



For final exaa 
Please read stateaent 17. 
Test length(»inutes) = 360 
Please read stateaent 18. 
Please read stateaent 19 c. 
Content tested = 2 
Plaase read stateaent 21. 
Proctor s 0 

Please read stateaent 22. 

Machine scored « 1 
Please read stateaent 23. 

Scheduled scoring = 1 

Please read stateaent 30. 
i-^anned review = 2 

Please read stateaent 31 a. 

For topic quiz 

Allocate tiae for review = 0 

Please x^ead stateaent 31 e. 

For final exaa 

All<>cate tiae for review = l 

Please read stateaent 32. 

Scheduled s 1 

Please read stateaent 33. 

Prepare special aaterials = i 

Please read stateaent ZH. 

Minutes = 120 



ALL OF TYPE 1 INSTRUCTION 



Please read stateaent 59. 

Easy s 1 
Difficult 5 1 



SCHEDULED EASY TYPE 1 

Please read statements 71 a and b« 

Pacer = u 

Please read statement 80 • 
Recorded response = 1 
Please read statement 
Level of monitor = 0 
Please read statement 72 • 
Grouping = D 

ALL OF SCHEDULED TYPES 1 AND 2 

Please read statement HO, 
Discussion opportunity : 1 
Please read statement Hl^ 
Scheduled discussions » 1 
Please read statement * 42 • 
Percent » 10 

Please read statement U3« 
Type of discussion schedule - 2 

SCHEDULED DIFFICULT TYPE 1 

Please read statement 86 • 

Policy change for difficult Type 1 instruction 
Please read statements 71 a and c« 
Pacer = 2 

Please read statement 80* 
Recorded response = 1 
Please read statements 81 a and c« 
Constructed response = 0 

Please read statement 83 • 
Answers given = 1 
Please read statement 84 • 
Level of monitor = 0 

ALL OF TYPE 1 INSTRUCTION 

Please read statements 47 a and h. 
Test with selected response = 1 
Please read statement 48 • 
Printed tests = 0 

ALL OF UNSCHEDULED TYPE 1 INSTRUCTION 

Please read statement 50 • 
Homework - 0 

ALL OF TYPE 2 INSTRUCTION 

Please read statement 90* 
Individual s 1 
Group s 0 
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ALL OF TYPE 2 INSTRUCTION, INDIVIDUAL PERFORMANCE 



. ^ Please read statement 100 • 

Simple s 6 
Complex = 1 

TYPE 2 INSTRUCTION, COMPLEX INDIVIDUAL PERFORMANCE 

Please read statement 120 • 
follow-'me = 1 

Please read statement 110 b. 
Scheduled exercises = 1 
Please read statement 112 a« 
Please read statements lUO a and c« 
Constructed response = 1 
Selected response = 1 

SCHEDULED TYPE 2, COMPLEX PERFORMANCE 
WITH CONSTRUCTED RESPONSE 

i 

{ Please read statement .175 a. 

i Please read statements 185 a and b« 

I The presentation of difficult Type 1 instruction was paced by 

i the individual student. 

Policy change for exercises with constructed response = l 
Please read statement 155 e. 
\ Pacer = 3 

\ Please read statement 72. 

I Grouping = 0 

Please read statement 7U. 
Programmed guide » 0 

Please read statement 78 a. 
Background materials s 1 
Please read statement 192. 
Answers given = 1 
Please read statement 193. 
Recorded response « 1 
Please read statement 122 a. 
Demonstrator(follow-^M) = 1 
Please read statement 123 b« 
Guide for follow^me demonstrations = 1 

SCHEDULED TYPE 2, COMPLEX PERFORMANCE 
WITH SELECTED RESPONSE 

Please read statec^ent 176. 

Policy ch^ge for exercises with. selected response » 1 
Please read statements 185 a, c, and d. 

The presentation of difficult Type 1 instruction was paced >y 

the individual student. 
Policy change ^0 
Please read statement 122 a« 
Demon8trator(foilow^»e) « 1 
Please read statement 123 b. 
Guide for follow^me demonstrations = 1 
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ALL TYPE 2« COMPLEX PERFORMANCE 



Plcrase read stattmtnt 113* 

Please read statesents 113 a and c* 

The presenter for conplex individual performance w/ constructed response: 
a live instructor* 

Policy change for demonstrations s 0 

Please read statement 116* 

Guide for pure demonstrations s 1 

Please read statement 12^ b* 

Unscheduled exercises = 0 

Please read statement 130 b* 

Test with selected response = 2 

Please read statement 

Printed tests = 0 



A 



Appendix D 
LIST OF VARIABLES IN NUMERICAL ORDER 



Variable Value Meaning Manual Statement No. 

For course in general 

A(l) 1 Tailor strategies for parts of course. 3 

2 . . .entire course . ^ 

3 ••.none of the course • 

A(2) 1 Entire course variably paced • 8 

2 Some types of instruction variably paced • 
0 None of course variably paced • 

For Types I and II instruction 

A(^) 1 Natural*- subject matter groupings being used 15b 

for evaluation^ 
0 Fixed-time schedule... 

For Type 1 Ins truction 

A(5) Type I difficult instruction now being Automatically ^et 

processed. 
0 Type I simple. . . 

For appropriate subcategory of instruction 

(6) 1 Presenter is instructor. 77a & c 

2^ ...any appropriate communication medium. . (or 77a, d, & f) 

3^ ...student leader. (or 77a & b) 

4 ...adaptive program, (or 190a & 160e) 
5^ •••fixed-duration program^ (or 190a & 191) 

7 •••response-paced program^ (or 160a & d) 

(or 160a & 161a & b) 
(or 190a & J60d) 



^ available only if method adaptive; 7 available only if variable 
pacing; 3 available only if variab'le schedule. 
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Variable Value Meaning 

(7) 1 Stim':!li for overt response integrated with 

scheduled basic instruction. 
0 Stimuli not integrated... 

(8) 1 Responses permanently recorded. 

0 Responses not recorded. 

(9) 1 Constructed responses required. 

0 Selected responses permitted. 

For Types I and II instruction 

MIO) 1 Selected responses made during classroom 

work are machine scored. 
2 Part of the work day used to score class work. 
0 Scoring of class work up to instructor. 

A(ll) 1 Allot scheduled or unscheduled time to 

review each evaluation. 
2 ...some evaluations. 
0 Students review on their own. 

A(12) P Percentage of presentation time set aside 

for discussion sessions. 

For appropriate subcategory of instruction 

(13) 1 Variable pacing used. 

0 . . .not used. 

(lA) 1 Pacer is student leader. 

2 ...individual student. 

3 .. .instructor. 

4 ... response-paced prograaa. 

(15) 1 "Students grouped by learning rate. 

0 Each student proceeds at own rate. 

(16) 1 Programmed guide supplied. 

0 . , .not supplied. 

For Types I and II instruction 

A(17) 1 Student can discuss material presented by a 

communication medium in a special session 
with an instructor. 

2 ...during the presentation with a monitor 
or instructor. 

3 No special arrangements made to discuss 
presentations-by communication media. 

For all relatively compl<>x Type II 
instruction 

H(17) 1 Follow-me demonstrations given. 

0 . . .not given. 

For Types I and II instruction 

A(18) 1 Discussions scheduled duxlng regular 

class hours. 
2 ...outside of regular clsss hours* 



Manual Statement No. 
79b 



80 

(or 193) 

81a & c 

(or 81a & b) 



38a 



30 



42 



70a & c 

(or 70a & b) 

(or 137a) 

71a & c 
(or 71a & b) 
(185a & d & 155f) 
(155a & e) 

72 



7A 



40 



120 



41 
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Variable Value Meaning Manual Statenent No. 

For relatively complex Type II instruction 

1 Follow-me demonstrations scheduled. 121 
0 ...unscheduled. 

(^^) 1 Instructor presents follow-me demon- 122a or 122b 

strations. 

2 Any appropriate communication medium... 

3 A student leader... 

5 A fixed-duration program... 

(1 and 3 not available if demonstrations 
unscheduled) . 

For Types I and II instruction 

A(20) 1 Instructor or monitor must be physically 45 

present during presentation by a communi- 
cation medium. 
0 ...does not have to be physically present. 

For appro priate subcategory of instruction 

^2^) 1 Background materials and instructional aids 62 or 78a 

supplied. 

2 Stratified background materials and instruc- 
tional aids supplied. 

0 Instructor expected to obtain or prepare his 
own materials. 

For Types. I and II instruction 

^(22) 1 Instructor or moni^tor must be accessible 46 

continuously during presentation by a com- 
munication medium* 
0 ...does not have to be accessible contin- 
uously. 

For appropriate type of instruction 
(23) 1 All formal examinations by objective 47b 

. V®®*^®: (or I30a or 131a) 

^ Formal examinations by objective tests 

for only relatively easy instruction. 
0 No formal examinations by objective 

tests. 

(24) 1 Students have homework assignments* 50 

0 ...no homework assignments. 

For course in general 

A(28) 1 vmen variable pacing is being used, re- 10 

wards will include additional free time. 
0 Rewards will not include... 

For appro priate subcategory of instruction 
— (29) 1 Acceptable response presented after 33 

student has had. time to respond^. (or 192) 

0 Acceptable response not presented*.. (or 162) 
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Variable 



Value 



Meaning 



Manual Statement No. 



A(30) 
A(37) 

_(39) 

A(41) 
(45) 



J46) 

J47) 
(48) 



(50) 



A(51) 



A(53) 



0 
2 

4 
5 
7 

1 
0 



1 
0 

1 
0 



For course In general 

Course content adapted to student back- 
ground. 

Course content not adapted. 

Tracking used to facilitate adapting 
method to student capabilities. 
Other means used. 

For appropriate subcategory of Instruction 

Stimuli for overt response Integrated with 
assignments for unscheduled study. 
Stimuli not Integrated.,. 

For Type II Instruction 

Type II difficult Instruction Is now being 
processed. 

Type II simple Instruction... 

Assignments for unscheduled study by any 
appropriate communication medium. 
...an adaptive program. 
...a fixed-duration program, 
..,a response-paced program. 

Acceptable responses provided. 
Answers not provided. 

Student responses in unscheduled study 
recorded, ] 

Student will be able to "study" the 
material (have Internal random access). 
...will not have Internal random access. 

For appropriate subcategory of Type II 
Instruction 

Models of student performance presented 

by Instructor. 

...a communication medium. 

...a student leader, 

...a fixed-duration program. 

Types I and II Instruction 

Instructor will have parpof his, workday 

for scoring formal examlti'ations/ 

• .,wlll grade papers on;his own time. 

For course In general 

Students expected to master course content 
on fixed schedule. . * 

,on variable schedule. 



Input from 
general policy 

Input from 
general policy 
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Automatically set 



51 

(or 125c) 
(or 126b) 



53 

(or 126a) 
(or 126b) 

127a & c 
(or 127a & b) 

54 



113 fir 115b 
115a or c 



23 



Input from 
general policy 
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Variable Value 



Meaning 



Manual Statemenc No. 



(54) 



_(55) 

A(56) 

A(57) 
A(58) 
A(59) 

A(60) 



(61) 



H(62) 



(63) 



1 

0 



1 
0 

1 
0 



For course In t^eneral or for appropriate 
subcategory of Instruction 

To facilitate adaptlvlty of method, students 65b 
divided Into two groups— slow and average- (or 65a) 

to-bright. 

...Into three groups — slow, average, and ' 
bright. 

...Into two groups— slow-to-average, and 
bright. 

Each student treated on an Individual basis 
(no tracking) . 

For appr opriate type o'f Instruction 

Reviews and examinations presented by 
printed materials. 

...by same means as original Instruction. 

For Types I and II Instruction 

Instructor must be physically present for 
discussion sessions* 

...does not have to be physically present. 

Objective tests machine scored. 
...not machine scored. 

Students score their work In class. 
...do not score their work In class. 

Instructor has part of his workday for 
scoring constructed responses made during 
classroom work. 

...roust score this on his own time. 

Indicates the bright loop of the grouping 
section Is being processed. 
...the average loop (Including slow-to- 
average, average-to-brlght, or If no 
grouping, the Individual). 
. . .the slow loop. ^ 

Fo r Type I Instruction of the appropriate 
level of difficulty 

Any appropriate communication medium used 78b 
to make presentations requiring special 
facllltlec o- equipment. 
. . .not usee 

For relatively complex Type II Instruction 

The Instructor or student leader given a 123 
guide for making follow-me demonstrations. 
. . .not given guide. 

For appropriate subcategory of Instruction 

Teaching method adapted by an Instructor. 
...an adaptive program* 
...the individual student. 
....a student leader (3 and 4 not allowed 
if fixed schedule) . 



48 

44 

22 
37 
38b 

Automatically set 



61a, b, d , & e 
(or 61a, b, c, & 
(or 61a, d, & f) 
(or 180 & 182c) 
(o 180 & 180a & 



e) 



182b) 
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erJc .1 



1 



Variable Value 



Meaning 



Manual ScaCenenc No* 



(or 150 & 
(or I52d) 
(or 180 & 



\52a) 



182d) 



For course in general 

A(6A) 1 Remedial sessions scheduled. 

2 .assigned for unscheduled scudy. 

For appropriate type of instruction 

(72) 1 Homework checked. 

0 Homework not checked. 

(73) M Average number of minutes spent in class 

checking or discussing an assignment for 
unscheduled study. 

For course in general 

A(76) 1 Students categorized on the basis of 

prior information on their backgrolind. 

2 ...evaluation of work ^fter an initial 
period of time. 

3 ...a diagnostic pretest. 

For Types I and II instruction 

A(77) 1 Discussion sessions held at regular 

intervals. 

2 ...whenever 15 minutes of discussion have 
accumulated. 

3 ...following difficult topics. 

For appropriate subcategory of instruction 

(78) 1 The monitor is an instructor. 

2 ...an instructor's aide« clerk* or student 
instructor. 

3 •••a student leader. 
0 No monitor necessary. 

(80) N Number of levels to be grouped by student 

learning rate. 

For the appropriate type of instruction 

(85) 1 Scheduled class time will be devoted to 

checking or discussing homework assignments* 
0 ...will not be devoted... 

For course in general 

A(95) 1 Remedial work provided* 

2 Students not allowed to repeat sections* 

3 Both of the above used. 

A(96) P Percentage of time required for basic in- 

struction required for additional scheduled 
remedial sessions. 



55 
57 



A3 



84 



73 



56 



7a 
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Variable Value 



Meaning 



Hanual Stacenenc No* 



A(97) 



e(Ui) 



e(2,i) 



e(3,l) 

e(3,2) 
e(3,3) 
e(4a) 



e(4,2) 

e(4,3) 
e(A,4) 

e(5,i) 

/ 

e(6.i) 



I Instructor conducts scheduled remedial 
sessions* 

0 Remedial sessions conducted in same 
manner as basic instruction* 

1 A formal evaluation given after each 
topic (i-D* 

***each major section (i«2)* 
***the end of the course (1"3)* 

0 .***will not be given* 

1 A formal examination given after each 
day*8 work (i-D* 

***each veek*8 work (i"2)* 
***edch major section (i«3)* 
***the end of the course (i-4). 

0 ***not given* 

1 Quiz at the end of a topic covers only 
that topic* 

2 ***th3t topic and others in the s;^ 
major section* 

3 ***that topic' and all preceding lessons* 

1 The examination at the end of a major 
section covers that section only* 

2 ***that section and all preceding sections* 

1 The final examination covers the last major 
section of the course only* 

2 ***the entire course* 

1 The dally quiz covers that day*s work only* 

2 ***that day*s work and all preceding in 
the week* 

3 ***that day*s work and all preceding in the 
same major section* 

4 ***that day*8 work and all preceding in the 
course * 

1 The weekly quiz covers the week^s work only* 

2 .**the week's wor^ and all work in the same 
major section* 

3 ***the week's work and all preceding work* 

1 The examination on a major section covers 
''hat section only* 

2 ***that section and all preceding sections* 

1 The final examination covers the last 
major section of the course only* 

2 ***the entire course* 

1 Type I instruction (1-1), 
Type II instruction (i»2), 
Type'lil instruction (i-3) 
used* 
. 0 * * *hot used* 

1 Relatively easy (i"l), 

relatively difficult (i«2) 

Type II instruction used* 
0 ***not used* 



7a 



16b 



16a 



19a 

19b 
19c 
20a 



20a 



20c 



20d 



11 



59 
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,ERiC 



Variable Value 



Meaning 



Manual Scacemenc Ko. 



c(7,i) 



e(8,l) 



e(9,l) 



For Type II instruction 

Individual skills (i-1), 
team skills (1-2) 
taught. 

•••not taught. 

For Type II instruction, individual skills 

Simple skills (1-1), 
complex skills (1-2) 
taugh t . 

• • •not taught^ 

For slnple Type V Instruction, Individual 
skills 

Selected responses (1«1) , 

const n*^ted responses (1-2) 

may be used to check student mastery of 

some skills^ 

• • •cannot be used^ • • 



90 



100 



140a 



e(10,l) 



e(ll,l) 



e(12,l) 



a(13.1) 



e(i4,l) 



0 



0 

1 



For complex Type ii Instruction ♦ Individual 
skills 

Selected responses (1<*1) , 

constructed responses (1-2) 

may be used to check student mastery of 

some skills^ 

• • •cannot be used^ • • 

For Types I and n Instruction 

A review planned for" 

each dally quiz (1-1) « 

each weekly quiz (1-2), 

each major section examination (1-3) t " 

the final examination (1-A)^ 

• • •not planned • • • 

Scheduled review planned before 

each dally quiz (1-1), 

each weekly quiz (f*2)< 

each major section examination (1-3), 

the final examination (i-A)^ 

• • •not planned^ • • 

A review planned for 

each topic quiz (1-1) , 

each major section examination (1-2), 

the final examination (1-3) • 

• • •not planned • • « 

Scheduled review planned befota 

each topic quiz (1-1), 

each major section ejcamination (i"2), 

the final examination (1-3) • 

• • •not planned^ • • 



I40b 



3Ib 
3Ic 
3Id 
3Ie 



32 



3Ia 
3 Id 
31e 

32 
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;:eric 



Variable Value 



Meaning 



Manual Statement Ko« 



e(15,i) 



e(16,i) 
e(17,l) 

e(18,i) 
e(19»i) 
c(20,i) 

e(2M) 

e(25.1) 
e(26»i) 



e(27»i) 



0 
M 



1 
2 

3 
0 



Special review raatcrials prepared for 

each daily quiz (i«l)» 

each weekly quiz (i"2)^ 

each najor section examination <i»*3)» 

the final examination (i»A)« 

«««not prepared««« 

Number of minutes required to review for 

each dally quiz (l«l), 

each weekly quiz (i"2)» 

each major section examination (i"3) » 

the final examination (i"A)« 

Special review materials prepared for 
each topic quiz (1*1), 
each major section examination (i»2)» 
the final examination (i-3)« 
•••not prepared^^. 

Number of minutes required to review for 
each topic quiz (i«l) , 
each major section examination (i"2)» 
the finul examination (i>"3)« * 

Number of minutes required for 
each topic quiz (i*l), 
each major section examination (i"2)» 
the final examination (i-3). 

Number of minutes required for 

each daily quis (1*1) » 

each weekly quiz (i«2)» 

each major section examination (i*3)» 

the final examination (i*^)« 

Special instructor provided for 
the slow track (i*l) « 
the fast track (i«2) • 
• .•not provided^ •• 

When variable pacin;* is bein<x uscd» the 
students are rewarded for achievement* 
•••are not rewarded^ 

No proctor :ised for 

the topic quiz (X«l) « 

the major section examination (i«2)» 

the final examination (i«3)« 

An instructor^ • • 

An instructor's aide» a student instructor » 

or a clerks •• 

A student leader^^^ 

No proctor used for 

the daily quiz (i«l) , 

the weekly quiz (i«'2) » 

the major section examination (i«3)» 

the final examination (i«A)« 

An instructor^ • • 

An instructor's aide, a student instructor » 

or a clerks •,• 

A student leader^«^ 



33 



34 



33 



34 



17 



17 



4a 
4b 

9a or 9b 
21 



21 
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GLOSSARY 



Adi^tivify; adaptive inatructioiu Instruction that provides some students 
in a course with different instruction than others^ Theze are many reasons for 
adapting instruction and many techniques for doing it. Some reascms are differences 
in (1) prior student preparation; for the course (2) innate diar^urteristics (intellec- 
tual, p^chological, or physical) that affect the stud^f^s learning ability and (3) 
'learning style/' particularly the rate at which the student can master piateriaL 
Learning rate quite probably depends on both student capability and motivation. 

Techniques for adaptivity include acUusting whaiia taught or howit is tau^^t 
to student achievement, learning ci^Mbility, or maturity. See grouping tracking 
and uariabk pacing. 

Adaptive programs: Instructional programs presented by a communication 
medium that a4justs the contehtof the presentation to the student's response, and 
may be either response^paced or leamer*paced. The adaptivity of content may con- 
sist of a discussion of why a particular response is rig^t or wrong, branch the student 
to materials of varying levels of difficulty, present him with remedial instruction, 
or leapfrog him past material he has maatered. See learner-paced and response- 
paced. 

Affective draudn: Subject matter pertaining to feelings, emotions, and atti- 
tudes. 

Appropriate eominniiicatioh me^um: Any communication medium that 
can carry the message* There iEure eifi^t classes of oonmiunication niedia, including 
such specific examples as fifan, TV, audio tape, radio, and books; Each class is 
appropriate to a different type of message; 

Average student: The student for whom the bulk of the instruction is de- 
signed. Average refers to the student population of immediate concern to the de- 
signer. The iaveiage student in a given course may have inore or less capability to 
learn the subject thaii the norm for those of his own age or experience. . 

Basic instructipii: See learning event, type of instruction. 
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Between-fiession adaptivity: Instruction adapted between periodic sessions 
of instruction. The adapter reviews the record of the learner's response to one 
session to obtain guidance for preparing the subsequent session. 

Capability (student): Student ability to le?im the material. Capability is a 
mixture of motivation, prior achievemmt, and innate traits (mental, emotional, or 
physical). ^ - - 

Carrel: A table withshdves for books, tapes, and the like that is often witi^'^' 
tioned or enclosed and is used for individual study. 

Cognitive domain: Subject matter pertaining to the recall or recognition of J 
knowledge and the development of intellectual capabilities and skills. 

C ommnnic a t ion aids: Audiovisual, aids such as flip charts, mockups, and 
Vu-graphs requiring the message sender to be present at the point of reception* 

C ommnhic a tio ii medfoBi: A self-contained means of communicating— the 
message sender need not be present at the point of reception. 

Complex instroctioii: Instruction t|iat requires student mastery of several 
interrelated steps, fiicts, or the like to attain the instructional objective, such as 
solving a problem, writing ah essay, or diecldng a piece of equipment 

A lesson on the causes of the CSvil War, for instance, can be relatively complex 
if the student is expected to comprehend the political, social, and economic situa- 
tkms that lasted in the North and South and to understand how these situaticHis 
reinforced the South's move to secession* If the.leason only requires the student to ' 
mratiorize a list of causes of the Civil War, howisver, relati^ly simple instruction 
would be involved. 

^Relatively complex skills typically caimot be mastered by simply automatic 
drill exercises an d often can be tau^t most effectively by giving step4>y-step direc- 
tkms or foUoW'^ demonstrations. 

Concurrent adaptivi^ An adaptation of instruction that occurs during in- 
struction, with the agent of instruction and the learner interacting directly. 

Construct respraae: Devised the sbident, ^o responds by producing 
somefeiog--«peaking, writing, drawing, gesturing, using a tool, operating a ma- 
chin^ making something, Compete «e&cfed response, 

Conventionid instroction: Lidudes daasroom methods such as lecture, oral 
quiz, guided discuanon, and drill, plus the use of texts and workbooks. Also includes 
instructor deiMnstratiqns in.tiie 

Covert reofpcmae: A rei^nse tibat is not observable-HEm internal reaction. 

IHsciiflricn: IW types are era 
sion set aade after a segment i^heaac instructipn tc anraner studeht questions or to 
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stimulate student discussion of material just covered. Not considered a separate 
learning event in the Curriculum Analysis but taken f nto account in the DISTAF 
program for determining instructional strat^. Sed question-and-answer. (2) A 
learning event prepared primarily to* teach students to converse and interact in a 
group; considered as Type n instruction (team skills). 

Drill: An activity intended to help the student learn a relatively simple skill 
by repeated, relatively automatic response to a stimulus, which is usually provided 
externally as in typing from printed or written text or repeating the pronunciation 
of foreign words. The student provides his own stimulus in most independent study. 
See practice. 

Equipment: See special equipment 

Evaluation: Any measurement or assessment of student achievement, for- 
mal or informal. A quiz, test, performance test, or final examination, used to meas- 
ure student progress and, in some instances, to regulate advancenient from unit to 
unit or section to section. 

Eveqt, learning: See learning event 

Examination: A formal evaluation. 

Facilities: See special facilities. 

FizeMuration programs: Media presentations that occupy a fixed (invari- 
ant) period of time; films, television programs, and audio tapes are examples* Any- 
thing that "runs'' essentially without interruption and whose pace or content cannot 
be changed from the outside. A user cannot ordinarily go back over the material or 
select material at random from within the program as he can, for example, with 
books and workbooks. See internal random access. 

Follow-me instruction: A,step4>y-6tep demonstration of procedures which 
students copy or which students practice following step4>y-6tep directions. Such 
instruction applies only to individual skills and is used injnther Type TL or Type III 
instruction. 

Formal evaluaticm: See examination. _ 

Groups Homogeneous divisions of a heterogeneous class by student capabil- 
ity or preparation for a course and thus the special oirriculuni they follow. Permits 
r^rouping from time.to time to adjust to tlie:a>mplexiiy of the material. 

. Independent study: Study by individual stadents or groups pf students at a 
time of theiir own dioosing at home or.at school, with no insfaructor or monitor 
present Includes homework. Synonym for unscheduled instruction. 
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Integrated stimuli: Stimuli for overt student responses that are integrated 
with the presentation of material; the presentation allows time for the student to 
respond or halts entirely until he gives the correct response. 

Internal random access (IRA): Required when the indivi'dual needs to study 
a presentation, as distinguished from merely attending to it,^5vith or without re- 
sponse. Full IRA provides the following controls: start, stop, freeze-frame in the case 
of motion*visual media, fast forward, fast reverse, and some kind of indexing system. 
Partial random access may la<i freeze-frame and/or indexing. Conventional text- 
books have internal random access; scrambled books and filmstrips usually do not 

Interrelated objectives: See simple instruction and complex instruction. 

Leamer^paced programs: Instructional programs that can bej)resented hy 
any medium if they are used in such a mode that the:pn%nun contains int^rated 
response stimuli, and either stops automaticfdly or £be Ibamer himself may stop it 
manuall y after each stimulus to give his response. When the learner completes his 
response, he restarts the program. For example^ the program may demonstrate a 
step to take and then show what tlie results should be. The student then copies the 
step and compares his results with those shown. If he is satisfied with the match, 
he signals the program to proceed to the next step. Since the learner is evaluating 
his responses (rather than a machine doing it), constructed responses may be used 

Programmed texts, like any printed materials^ are paced by the user's reading 
rate. Since they int^rate stimuli for response, they are further paced by th^^r's 
^responses. Since the user of a programmed text evaliiates his own responses, 
whether constructed or selected, programs in this medium are learner-paced. The 
variation known as the scrambled book attempts some d^ree of adaptivity, direct- 
ing the^user to different material according to his responses. Aitho^igh printed, 
programmed materials are not designed for free access, some learners do skip 
around in them, sampling the various branches supplied, and to some extent choos- 
ing their own content. Thus, these may be considered either learner-adapted or 
program-adapted* 

Learning event: Any instructional activity that can be assigned to a single 
subcategory of instruction. 

Lesson: A unit in a course based either on content or time interval. May be 
less than, equal to, or greater than a topic. See fopic 

IxxskHBtep instruction: Such teaching exposes all students to approximately 
the same basic instruction at the same time; all students are also given the same 
examinations at the same time. There may, however, be provisions for remedial 
sessions or enrichment lessons in. conventional lock-step instruction. In addition, 
tracking or witHin-class grouping may be used. 

Mil!&r section: See secHofi 
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Materials: Media software. Either instructional aids or communication 
media programs (including printed materials). 

Media: See communication medium. 

Model of Performance: Demonstration of a skill that the learner must mas- 
ter. 

Modularized materials: Materials that deal with small units of subject mat* 
ter prepared for several levels of learning difficulty. The definition is more "opera- 
tional" than conceptual. If the materials are sufficiently flexible that programs may 
be drawn from them to fit each student's prior background and capability, they are 
modularized. ^ 

Objective tests: Examinations whose items call for selected responses. 
Overt response: An observable response. 

Pacen The agent that adjusts the rate of stimuli presentation to fit the stu- 
dent's learning rate: the learner himselfi the instructor, a response-paced program, 
or a student leader. 

Performance: Instruction in which the student is learning how to do some- 
thing (not simply acquiring ideas or information, but acquiring a skill). Performance 
denotes student activity in Type Jlor Type III instruction. For example, making a . 
map is IVpe n performance; repairing an engine, Type IBL Student responses in 
IVpe I instruction (answering questions, filling in blanks in a workbook, etc.) are not 
considered performance. 

Practice: Student perfoimance in leaniing relatively complex skills as distin- 
guished from performance in ieaming relatively simple skills that we\teiin drill 
Practice is less repetitive and automatic than drill; a student may practice some 
complex skiU, such as troubleshooting or writing a business letter, only a few times 
during the course and may have a slightly diflferent assignment each time. The 
presentation of stimuli is less important for practice than for drill, but the demon- 
stration of skills to be learned is more important. 

Presentation: Any communication to the student. Includes transmitting 
facts or concepts; demonstrations; giving^ directions; supplying stimuli for drill; 
describing probleins to be solved; 

Psychomotor skillsK: Skills requiring muscular movements, usually 
manipulative, e.g., hand-eye coordination, pronunciation, handwriting, and using 
tools. Because most such skills require a cognitive support (are more than automatic 
motor responses), we arbitrarily use the term psychomotor to refer to all motor 
skills. 
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Que8tion-and*aii8wer: A period for the informal answering of students' 
questions or for discussion. Does not include questions answered during the course 
of instruction. Not considered a separate learning event in the Curriculum Analysis; 
MODIA automatically accounts for them't)n the basis of stated strategy. See discus- 
sion. 

Remedial instructiom Instruction intended to assist students who fail to 
master a particular lesson or learning event, as opposed to actual review or makeup 
sessions. 

Response^paced programs; Instructional programs that can be^presented 
by any medium if they are used in such a mode that the program contains integrated 
response stimuli, and stops after each unit of presentation (or frame) to allow the 
learner toselectaresponse, then proceeds to the next unitofpresentati^^ only when 
the correct response has been selected. Most simple teaching machines (without 
brmiching) present i^ponse-paced pipgrams. Since student responses must be 
sensed and evalimted by machine^ constructed responses cannot be used; machine 
scoring and recording are possible^ however. 

Review: An abbreviated version of earlier instruction to refresh the learner's 
memory or skill in preparing for an examination. Not listed as separate learning 
events in the Curriculum Analysis; MODIA automatically accounts for them on the 
basis of stated strategy. 

Scheduled instruction: Instruction designated for a specific time and place. 

Scoring deskwork: Scheduled instructional time set aside for evaluation of 
a student's work by the student himself or by another student. Such sessions are not 
considered learning events in the Curriculum Anal3^;~M0DIA automatically ac- 
counts for them on the basis of stated strat^. 

Sectiom An unbroken sequence of topics treated as a unit either because it 
deals with related course content or because it occupies a major fraction of the 
course length* The definition is intended to identify course subdivisions that are 
subject to examination. 

Selected response: Student responses selected from among two or more an- 
swers» or placing a list of items in some correct, order. Mutiple<;hoice, true-false, 
matchingsandoideringaUcaUforselededresp^ constructed r^ponse. 

'Simple , instructiom Instruction that does not require . the student to master 
several interrelated steps, facte, pr ^e jke, Activities iliat characteris&e simple 
instruction include memorizing foreign wprd^ l multipjicatipn tables, plot- 

ting pointe on a graph, ti^^ sending code. Adipn yei^ that 

relatively siihple insthictionin-tiie cognitive domidh includer'name, list) eptXi^ iden- 
tify, choose, find, select, and match. Relatively sm sliUs are iiiose that &e 
student can typically master by fairly routine, repetitious^ or automatic drill. 



152 



Note that these may not be simple skills for som^ students whose background 
is deficient. Therefore, determining whether the instruction is simple or complex 
depends on the level of average student capability as much as it does on the skill 
itself. 

Special equipment: Equipment (or other materials) students must work with 
other than the traditional paper and pencil, drawing instnunents, slide rules, or 
other small implements. Such materials (1) are so expensive and fragile (such as 
precision measuring instruments) or dangerous (such as corrosive acids) that a 
monitor or other responsible person must supervise student work or (2) require 
special fedlities. 

Projectors, playback devices, and the like, that are used for communicating 
with the student are not covered by this term unless they themselves are the subject 
of study. 

Special facilities: Areas that differ from a conventional classroom, such as 
workshops, laboratories, hangars, playing fields, and gymnasiums.- 

StratijBed materials: Materials that present the same general subject on sev- 
eral levels of difficulty. Stratified materials can be completely modularized for in- 
dividualized instruction or can be prepared in graded sets for ase by groups or tracks 
withm a class or at a given grade level. 

Subca^ory of instraction: An instructional activity with a particular com- 
bination of resource requirements. 

Team: Two or more individuals who work together. In our sense, the people 
playing a two-handed game form a team as do the people using a transit and chain 
to determine the placement of a survey marker. 

Topic: A coherent set of ideas or skills that the student masters as a unit of 
course content and ^t could serve as the subject of formal evsdimtio^iCca^ span 
several class sesisions or could occupy less than a sii^e class session. Th0 definition 
provides a finer division of course content than the mcgor section for scheduling 
examinations and reviews. See lesson and section. 

Tracks: Subdivisions of a class ^t>i(p homogeneous with r^ard to student 
capability and the special curricida they follow. Students generally remain in the 
same track throughout a course;- 

Types of inatmctiom A broad categorization of instructional activity in- 
tended to aid system design. 

T^pe I iiistructioii: Requires no student use of special equipment and no 
student peiformance in spedfd fa^ In addition, students are no* quiring 
skills (cognitive, , pqrchpmdtpr, motor, or social) through drill or pract . Type I 
activities typically occur in the claissrpom and concern the presentation of facts or 
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concepts for the student to master or the presentation of goals or objectives to 
motivate him with a sense of direction for his learning. Frequently includes affective 
objectives (such as changes in attitude toward the subject) and demonstrations. Such 
instruction involves presentations, and may or may not contain int^rated stimuli 
that require overt student responses. 

Type n instruction: Like Ty^pe I instruction, requiring no specml facilities or 
equipment for student performance; however, students master skills that require 
drill, practice, or performance. The student learns to make particular responses 
when provided with directions and stimuli. Activities are those in which the student 
must do something besides answer questions. Also includes the presentation of 
models of skills to be mastered (even though no student performance may be re- 
quired during the demonstration) because demonstrations are frequently given im- 
mediately preceding or concurrent with student performance. Therefore, it may 
often be convenient to use the same means to present the models as those used to 
present directions for performance or actual drill stimuU. If a performance model 
is to be given but /lo^ immediately preceding or concurrent with the drill, practice 
or performance session, it may be categorized as a demonstration under Type I 
instruction. Type II instruction can include pure skill demonstrations (with no 
student response); follow-me demonstrations in which the students perform each 
step as they are directed or as it is presented; presentation of directions and stimuU 
for performance; and pure performance (with no presentation to the student). 

Type m instruction: Any instructional activity that requires the students to 
work with special equipment (such as a simulator^ a piece of machinery, or a musical 
instrument) or in a special facility (such as a shop, a laboratory, a parjade ground, 
or other special area) or both. See special equipment and special facilities. 

The instructor is no^using TypeUL instruction when he uses special equipment 
(such as a projector or mockup) to demonstrate a procedure or to clarify a concept 
(such as operating aircraft flight controls), unless the students are also required to 
use the same equipment at the same tiine (or immediately afterward). The rules for 
classifying performance models and presentations for T^pe TL instruction are the 
same as those for Type TEL instruction, hamdy, if the nipdel iinmediately precedes 
or is concurrent with student performance, it is most conveniently treated as Type 
in instruction; if the model will be separated in tiiue from student performance, it 
may be treated as Type 1 instruction. 

Unscheduled iniBtruction: See independent study. 

Variable pacing: The rate pf stimuli presentation to the student or student 
group varied on the basis of student response. Pacing may be varied to fit each 
individual student's learning rate or to fit the learning rate of a group. The use of 
response cards or other group response devices can facilitate group pacing, although 
often hand or voice responses to the instructor's questions can be used ^br the same 
effect. 
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